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Figure  1.  The  CASHE  “  vision  ”  is  to  have  ergonomics  data  available  in  a  computer- 
aided  design  environment. 
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Over  a  decade  of  prior  re¬ 
search  and  development 
aimed  at  understanding  and 
remediating  problems  in  the  transition 
of  ergonomics  data  and  models  to 
application  in  the  design  of  complex 
human-operated  systems  has  coalesced 
into  a  new  model  of  Computer-Aided 
Systems  Human  Engineering  (CASHE). 
As  its  objective,  CASHE  will  enable 
ergonomics  to  be  fully  supported  as  a 
“full  partner”  among  other  design  dis¬ 
ciplines  within  a  computer-aided  de¬ 
sign  environment,  as  shown  in  Figure 


1.  CASHE  will  offer  designers  of  crew 
systems  a  previously  nonexistent,  inte¬ 
grated  support  capability  that  enables 
access  and  modeling  of  human  perfor¬ 
mance  and  cognition  within  an  elec¬ 
tronic  prototyping  environment. 

he  first  implementation  of  CASHE, 
the  Performance  Visualization  Sub¬ 
system  (PVS)  Version  1.0;  is  sponsored 
by  the  Armstrong  Laboratory;  US  Fed¬ 
eral  Aviation  Administration;  US  Army 
Engineering  Laboratory;  Naval 
Command,  Control,  and  Ocean  Sur¬ 
veillance  Center;  Air  Force  Office  of 
Continued  on  page  2 


March/April  1992 


|  Scientific  Research;  Nuclear  Regulatory 
!  Commission;  and  NATO  AGARD. 

;  CASHE-P VS  Version  1 . 0  is  derived  from 
I  the  work  of  the  Human  Engineering 
Division  of  the  Armstrong  Laboratory. 
The  Human  Engineering  Division  has 
long  been  involved  with  the  research 
and  development  of  crew  station  de- 
i  sign  technology,  with  special  emphasis 
|  on  melding  the  needs  of  the  designer 
with  the  constraints  of  system  design. 

:  The  CASHE-PVS  Version  1.0  is  an  at- 
tempt  to  bridge  this  gap  by  aiding 
designers  in  accessing,  understanding, 

|  and  applying  human  perception  and 
!  performance  data.  This  has  been  ac¬ 
complished  through  the  integration  of 
|  traditional  ergonomic  data  representa- 
!  tion  formats  (e.g.,  text,  tables,  and  fig¬ 
ures)  with  alternative  representations 
|  (e.g.,  audio  and  animations)  and  with 
j  specialized  data  visualization  techniques. 

System  Description 

|  Information  Base 

;  To  promote  learning  and  ease-of- 
|  use,  CASHE-PVS  Version  1 .0  is  oriented 
!  around  a  bookshelf  metaphor  to  access 
reference  documents.  This  takes  ad¬ 
vantage  of  the  user’s  knowledge  and 
operations  with  the  hardcopy  media  on 
which  it  is  based.  The  Bookshelf  (see 
Fig.2)  consists  of: 

•  Engineering  Data  Compendium 
(Boff  &  Lincoln,  1988),  developed 
through  the  joint  efforts  of  the  Depart- 

i  ment  of  Defense,  NASA,  and  NATO 
;  AGARD  as  a  standardized  ergonomics 
data  resource  for  system  designers; 

;  •  MIL-STD-1472D  (Department  of 

Defense,  1989),  a  military  standard  for 
human  engineering  design  criteria  for 
systems,  equipment,  and  facilities; 

•  Perception  and  Performance 
Prototyper  (P3),  an  interactive  simula¬ 
tor  that  enables  users  to  experience 
and  explore  behavioral  phenomena 

■  contained  in  the  Compendium  and 
;  MIL  -STD- 1 4 7 2D,  and 

•  Project  Files,  a  collection  of 
information  which  the  user  may  add 
to  customize  the  system  and  store 
files  and  annotations  created  during 
a  session. 


Figure  2.  The  CASHE  Bookshelf. 
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Key  Terms 

Auditory  detection 
Auditory  sensitivity 
Broadband  noise 
Critical  band 
SignaJ  detection 
Simultaneous  masking 

General  Description 

When  a  signal  tone  is  presented  simultaneously  with  broadband  noise, 
the  threshold  for  detecting  the  signal  rises  (signal  detectability 
decreases)  in  proportion  to  the  level  of  the  noise  (Fig.  1 ).  For  signals  of 
frequencies  >400  Hz,  the  threshold  in  noise  increases  very  slowly  as 
frequency  increases. 

It  has  been  shown  that,  when  a  tone  is  masked  by  broadband  noise, 
only  a  narrow  portion  of  noise  centered  around  the  signal  frequency 
actually  is  effective  in  masking  a  given  signal  (Ref.  2).  This  narrow  band 
of  noise  frequencies  that  is  responsible  for  the  masking  is  termed  the 
critical  band.  Increasing  the  noise  bandwidth  beyond  the  critical  band 
does  not  increase  the  amount  of  masking.  The  size  of  the  critical  band 
varies  with  center  frequency,  but  for  frequencies  >1 000  Hz,  the  critical 
band  is  generally  equal  to  about  15-20%  of  the  center  frequency.  (For  a 
more  detailed  discussion  of  critical  bands  and  methods  ofdetermining 
their  size,  see  Ref.  6,  Sect.  3.2.) 


Figure  3.  Electronic  representation  of  an  entry  from  the  Engineering  Data  Compendium 
showing  TextViewer. 
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Figure  4.  Electronic  representation  of  an  entry  from  the  Engineering  Data  Compendium 
showing  FigureViewer. 
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Figure  5.  Electronic  representation  of  an  entry  from  the  Engineering  Data  Compendium 
showing  TableViewer. 


Users  can  access  and  navigate  the 
CASHE-PVS  Version  1 .0  information  base 
contained  in  the  four  volumes.  The  first 
three  volumes  may  be  opened  and 
closed,  leafed  through,  annotated,  tagged 
with  bookmarks,  and  include  a  facility 
for  comparing  “pages.”  The  fourth 
volume  may  only  be  opened,  closed, 
and  leafed  through.  The  many  opera¬ 
tions  that  one  normally  performs  with 
books  are  retained  or  augmented.  This 
ability  to  annotate  the  information  base 
enhances  its  personal  meaning  and  value. 

File  viewers  allow  the  user  to  view, 
interact,  manipulate,  and  analyze  the 
information  contained  in  the  docu¬ 
ment  entries.  In  CASHE-PVS  Version 
1.0  these  consist  of  a  TextViewer,  a 
FigureViewer,  and  a  TableViewer. 
These  viewers  allow  access  to  different 
data  types  while  keeping  the  overall 
context  of  a  unified  entry. 

The  TextViewer  (see  Fig.  3)  displays 
the  text  portions  of  an  entry.  This  data 
entry  format  is  designed  to  facilitate 
quick  and  efficient  viewing  of  the  data 
entries  and  navigation  to  other  perti¬ 
nent  entries. 

The  FigureViewer  (see  Fig.  4)  dis¬ 
plays  both  data  graphs  and  illustra¬ 
tions.  It  allows  the  user  to  select  figure 
panels,  control  the  display  of  overlays, 
zoom  the  figure  scaling  in  or  out,  and 
turn  the  figure  caption  on  or  off.  Where 
applicable,  the  user  can  select  either 
an  animation  or  interactive  demonstra¬ 
tion  which  further  illustrates  the  entry. 
If  the  figure  is  a  data  graph,  the  user 
can  access  the  DataViewer  to  further 
explore  analytic  relationships. 

The  TableViewer  (see  Fig.  5)  dis¬ 
plays  entry  tables.  The  first  row  and 
column  of  a  table  contain  the  row/ 
column  titles.  The  user  can  scroll 
horizontally  through  the  table  with  the 
first  column  remaining  “fixed”  while 
the  remaining  columns  “slide”  under 
the  column  title.  Likewise,  the  user  can 
scroll  vertically  with  the  top  row  re¬ 
maining  “fixed”  and  the  remaining 
rows  sliding  under  the  row  title.  The 
Table  Options  panel  allows  the  user  to 
select  multiple  panels  and  turn  the 
caption  on  or  off. 

Continued  on  page  4 


March/April  1992 


Visualization  Tools 

These  are  provided  to  aid  the  user’s 
understanding  and  application  of  the 
information  available  within  the  refer¬ 
ence  sources  on  the  Bookshelf.  First, 
users  are  able  to  manipulate  and  trans¬ 
form  quantitative  and  graphical  rela¬ 
tionships  contained  in  the  information 
base  or  brought  in  from  external  sources 
through  a  Data  Viewer  interface.  This 
provides  the  user  with  the  capability  to 
view,  manipulate,  and  display  data. 
Figure  6  portrays  the  selection  of  an 
existing  XY  graph,  digitization  and 
storage  of  the  resulting  XY  values  in  a 
table,  and  transformation  of  those  data 
values  into  a  new  function,  Z. 

Four  primary  functions  are  available 
in  the  DataViewer:  Data  Definition, 
Data  Acquisition,  Data  Transformation, 
and  Data  Presentation.  The  Data  Trans¬ 
formation  function  will  support  both 
monadic  and  dyadic  transformations 
and  limited  analyses,  including  statis¬ 
tics  and  polynomial  curve-fitting.  The 
Data  Presentation  function  offers  four 
display  formats:  histograms,  scatter- 
plots,  line  graphs,  and  tables. 

Second,  a  collection  of  test  benches 
referred  to  as  the  Perception  and  Per¬ 
formance  Prototyper  (P3),  has  been 
provided.  Using  the  test  bench  meta¬ 
phor,  P3  allows  the  user  to  manipulate 
and  interactively  experience  the  vari¬ 
ables  discussed  in  the  references  on 
the  Bookshelf. 
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Figure  6.  Electronic  representation  of  an  entry from  the  Engineering  Compendium  showing 
DataViewer. 


Figure  7.  Operation  of  the  Perception  &  Performance  Prototyper:  The  audio-masking  test  bench. 
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It  is  a  unique  feature  of  CASHE-PVS 
Version  1.0  which  allows  the  user  to 
manipulate  and  experience  alternative 
representations  of  the  technical  data 
found  in  the  reference  sources  in  the 
Bookshelf.  For  example,  after  consult¬ 
ing  the  Compendium  concerned  with 
how  noise  level  may  affect  audio  sen¬ 
sitivity,  the  user  may  have  uncertainty 
regarding  the  relevance  of  the  data  to 
specific  conditions.  Using  P ,  users  will 
actually  be  able  to  access  a  test  bench 
and  custom  control  panel  that  will 
support  test  and  experimentation  with 
the  combinations  of  variables  with 
which  they  are  more  directly  con¬ 
cerned.  In  the  instance  illustrated  in 
Figure  7,  the  user  can  dial  up  relevant 
signal-to-noise  conditions  and  can  then 
experience  the  resulting  aural  phe¬ 
nomenon,  first-hand.  Minor  variations 
in  the  phenomenon  can  be  explored 
by  selecting  different  noise  levels  or 
signal  types. 


Conclusions 

CASHE  attempts  to  circumvent  the 
problems  encountered  by  designers  in 
attempting  to  access,  understand,  and 
apply  ergonomics  data  by  providing  a 
comprehensive,  integrated,  and  easy- 
to-use  system.  This  system  will  include 
the  most  important  and  frequently  used 
ergonomics  handbooks,  but  in  elec¬ 
tronic  format.  Its  hypertext  structure 
will  allow  data  from  multiple  sources 
to  be  brought  together  for  analysis.  In 
addition,  it  will  present  data  in  alterna¬ 
tive  formats,  as  well  as  traditional  ones. 
Furthermore,  specially  created  visual¬ 
ization  tools  will  allow  designers  to 
manipulate  data  that  typically  cannot 
be  done  with  most  systems. 

As  ergonomics  data  becomes  more 
available  and  usable  as  a  result  of 
CASHE,  designers  will  be  more  in¬ 
clined  to  use  it.  This,  in  turn,  will  result 
in  the  design  of  more  user-friendly 


systems  which  will  improve  crew  per¬ 
formance,  reduce  workload,  and  re¬ 
duce  the  likelihood  of  human  error. 

CASHE-PVS  Version  1.0  is  a  first 
attempt  by  the  Human  Engineering 
Division  of  the  Armstrong  Laboratory 
to  provide  designers  with  an  ergonom¬ 
ics  “tool”  for  developing  efficient  and 
safe  human-operated  systems.  • 

Donald  L.  Monk  is  Program  Manager  of 
the  CASHE  Program  in  the  Human  Engi¬ 
neering  Division  of  the  Armstrong  Labora¬ 
tory,  Wright-Patterson  Air  Force  Base,  OH . 

Kenneth  R.  Boff  Ph.D.,  is  Chief  of  the  Hu¬ 
man  Engineering  Division  of the  Armstrong 
Laboratory. 


AN  ERGONOMIC  APPROACH 
TO  ERGONOMIC  DATA 


engineering  Data  Compendium:  Human  Perception  and  Performance  is  a 

landmark  human  engineering  reference  for  system  designers  who  need  an 
easily  accessible  and  reliable  source  of  human  performance  data.  Editors  Kenneth  R. 
Boff  and  Janet  E.  Lincoln  make  understanding,  interpreting,  and  applying  technical 
information  easy  through  their  innovative  format.  This  four  volume,  2758  page  set 
features  nearly  2000  figures,  tables,  and  illustrations  in  several  well  structured  ap- 
!|U  proaches  for  accessing  information.  Brief  encyclopedia-type  entries  present  information 
about  basic  human  performance  data,  human  perceptual  phenomena,  models  and 
quantitative  laws,  and  principles  and  nonquantitative  laws.  Section  introductions 
provide  an  overview  of  topical  areas.  Background  information  and  tutorials  help  users 
understand  and  evaluate  the  material. 

Engineering  Data  Compendium:  Human  Factors 

and  Performance  edited  by  Kenneth  R .  Boff  and  pQr  further  information  on  the  Engineering  Data  Compendium ,  contact: 

Janet  E  Lincoln  (1988) 
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The  COTR  Speaks 


Reuben  L.  Hann 


irst  of  all,  the  Gateway 
staff  and  I  want  to  extend 
our  thanks  to  all  the  read¬ 
ers  who  have  already  sent  back  their 
mailing-list  reply  cards.  The  response 
has  been  overwhelming — and  gratify¬ 
ing.  After  only  the  first  notification, 
more  than  2000  persons  have  taken  the 
trouble  to  fill  out  and  return  their  cards. 
That  is  about  one-third  of  our  circula¬ 
tion!  Although  the  primary  purpose  of 
the  response  cards  is  to  update  our 
master  mailing  list,  for  us  it  is  also  an 
indirect  measure  of  the  value  of  Gate¬ 
way  to  the  readers:  If  you  were  not 
finding  this  newsletter  interesting  or 
useful,  you  would  not  bother  to  take 
the  trouble  to  reply.  Your  response 
tells  us  that  we  are  doing  something 
right.  We  will  try  to  justify  your  confi¬ 
dence  in  us.  By  the  way,  if  you  have  not 
sent  in  your  update  card,  there  is  one 


in  this  issue;  please  take  a  minute  to  fill 
it  out.  Thanks. 

The  lead  story  in  this  issue  of  Gate¬ 
way  describes  the  Computer-Aided 
Systems  Human  Engineering  (CASHE) 
system,  under  development  at  the 
Human  Engineering  Division  of  the 
Armstrong  Laboratory.  It  takes  advan¬ 
tage  of  the  new  CD-ROM  technology 
for  storing  and  accessing  large  amounts 
of  multi-media  information  in  a  com¬ 
pact,  transportable  format.  CASHE  will 
integrate  human  engineering  informa¬ 
tion  into  all  aspects  of  the  human/ 
system  design  decision-making  pro¬ 
cess.  I  am  sure  you  will  find  this 
approach  an  exciting  solution  to  the 
long-standing  problem  of  providing 
ergonomics  support  to  the  designer  in 
a  form  which  is  truly  useful. 

We  were  pleased  to  have  Jens 
Rasmussen,  Professor  of  Cognitive 


Engineering,  RISO  National  Laboratory 
and  the  Technical  University  of 
Copenhagen,  Denmark,  as  the  second 
speaker  in  the  Armstrong  Laboratory 
Colloquium  Series.  Prof.  Rasmussen 
spoke  on  the  topic  of  “Virtual  Ecology 
of  Work  and  System  Design.”  In  this 
issue  CSERIAC  staff  member  Dr.  Ron 
Schopper  provides  a  synopsis  of  the 
presentation;  it  is  followed  by  excerpts 
of  a  conversation  Ron  and  I  had  with 
Prof.  Rasmussen  during  his  visit. 

Authors  Westermann,  Heasly,  and 
Welch  describe  a  new  tool  for  includ¬ 
ing  human/system  integration  and 
human  factors  engineering  in  the  ac¬ 
quisition  process:  IDEA  (Integrated 
Engineering/Decision  Aid).  It  is  based 
on  Macintosh  HyperCard  stacks 
and  provides  the  analyst  with  guide¬ 
lines,  data,  and  assorted  tools  designed 
to  ease  the  planning  and  execution 


Calendar 


June  10-14,  1992 
Denver,  CO 

Annual  International  Industrial  and  Safety  Re¬ 
search  Center  Conference,  sponsored  by  the 
International  Foundation  for  Industrial  Ergo¬ 
nomics  and  Safety  Research,  in  cooperation  with 
the  University  of  Alberta  and  the  Industrial 
Commission  of  Ohio,  at  the  Holiday  Inn.  Con¬ 
tact  S.  Kumar,  Dept,  of  Physical  Therapy,  3-75 
Corbett  Hall,  University  of  Alberta,  Edmonton, 
Alberta  T6G  2G4,  CANADA;  (403)  492-5979,  fax 
(403)  492-1626. 


July  2 9 -August  1,  1992 
Bloomington,  IN 

14th  Annual  Conference  of  the  Cognitive  Science 
Society,  at  Indiana  University.  Contact  John  K. 
Kruschke,  Conference  Chair,  Cognitive  Science 
Program,  Psychology  Bldg.,  Indiana  University, 
Bloomington,  IN  47405;  (812)  855-4658,  Email: 
cogsci92  @ucs .  indiana .  edu . 


October  12-16,  1992 
Atlanta,  GA 

36th  Annual  Meeting  of  the  Human  Factors 
Society,  hosted  by  the  HFS  Atlanta  Chapter,  at 
the  Westin  Peachtree  Plaza  Hotel.  Contact  HFS, 
P.O.  Box  1369,  Santa  Monica,  CA  90406-1369; 
(310)  394-1811  or  (310)  394-9793,  fax  (310)  394- 
2419. 


July  12-16, 1992 
San  Jose,  CA 

AAAI -9 2/1 AAI -92,  Tenth  National  Conference  on 
Artificial  Intelligence  and  Fourth  Annual  Confer¬ 
ence  on  Innovative  Applications  of  Artificial 
Intelligence,  sponsored  by  the  American  Asso¬ 
ciation  for  Artificial  Intelligence,  at  the  San  Jose 
Convention  Center.  Contact  AAAI-92/IAAI-92, 
445  Burgess  Dr.,  Menlo  Park,  CA  94025-3496; 
(415)  328-3123,  fax  (414)  321-4457. 


August  24-27,  1992 
Nottingham,  UK 

3rd  International  Conference  on  Visual  Search, 
organized  by  the  Applied  Vision  Association, 
Ergonomics  Society,  and  British  Machine  Vision 
Association  and  Society  for  Pattern  Recognition, 
at  the  University  of  Nottingham.  Contact  TICVS, 
Academic  Radiology,  University  Hospital,  Queens 
Medical  Centre,  Clifton  Blvd.,  Nottingham  NG7 
2UH,  UK;  44  (0)  602-0709442,  fax  44  (0)  602- 
709140. 


October  25-28, 1992 
Hamilton,  Ontario,  CANADA 

Human  Factors  Association  of  Canada/Associa¬ 
tion  Canadienne  d’Ergonomie  25th  Annual  Con¬ 
ference,  “The  Economics  of  Ergonomics.”  Con¬ 
tact  HFAC/ACE  Office,  6519B  Mississauga  Rd., 
Mississauga,  Ontario  L5N  1A6,  CANADA;  (4l6) 
567-7193,  fax  (4l6)  567-7191. 
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of  the  purchase  and  fielding  of  new 
military  systems. 

The  Armstrong  Laboratory’s  Human 
Engineering  Division,  like  many  other 
Department  of  Defense  organizations, 
recently  underwent  a  reorganization. 
In  this  issue  I  have  written  an  article 
which  gives  some  background,  the 
rationale,  and  a  description  of  the 
process.  I  have  also  highlighted 
some  of  the  research  programs  in  the 
various  branches  of  the  Division.  Inci¬ 
dentally,  we  would  like  to  feature  the 
restructuring  of  other  DoD  human  en¬ 
gineering  organizations  in  future  is¬ 
sues  of  Gateway . 

In  our  final  article,  CSERIAC  staffer 
Frank  Gentner  and  co-author  Mona 
Crissey  describe  the  “Liveware”  survey 
being  conducted  by  CSERIAC  for  NATO 
and  the  Office  of  the  Assistant 
Secretary  of  Defense  for  Force  Man¬ 
agement  and  Personnel.  The  survey 
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will  catalog  all  known  tools,  methods, 
and  databases  which  aid  in  the  Human 
Systems  Integration  (HSI)  process  of 
new  systems  acquisition.  HSI  is  a  new 
domain  for  CSERIAC;  in  the  future  we 
will  be  providing  support  as  a  central 
clearing  house  for  information  in 
this  important  area. 

I  hope  you  find  this  Gateway  inter¬ 
esting  and  informative.  As  always,  we 
solicit  your  feedback  and  suggestions 
for  articles.  If  you  have  written  some¬ 
thing  you  think  would  be  of  interest  to 
the  general  human  factors  community 
and  would  like  to  have  it  considered 
for  the  Gateway \  please  contact  me  or 
the  Editor,  Jeffrey  A.  Landis.  • 

Reuben  “Lew”  Hann,  Ph.D.,  is  the  Con¬ 
tracting  Officer's  Technical  Representative 
( COTR)  who  serves  as  the  Government  Tech¬ 
nical  Monitor  for  the  CSERIAC  Program. 


Request  for  Topics 

For 

State-of-the-Art-Reports  (SOARS) 

CSFRIAC  makes  every  effort  to  he 
sensitive  to  the  needs  of  its  users.  There¬ 
fore,  we  are  asking  you  to  suggest  pos¬ 
sible  topics  for  future  SOARS  that  would 
be  of  value  to  the  I  lunian  Factors. 'Ergon¬ 
omics  community.  Previous  SOARs  have 
included  Hypertext:  Prospects  and  Prob¬ 
lems for  Crew  System  Design  by  Robert  |. 
Glushko,  and  Three  Dimensional  Dis¬ 
plays :  Perception .  Implication.  Applica- 
tions  by  Christopher  l).  Wickens.  Steven 
Todd,  &  Karen  Seidler.  "tour  input 
would  be  greatly  appreciated.  We  are 
als( )  k x >king  ft  >r  spc  >nst  >rs  c  )f  future  SC ) ARs. 
CSFRIAC  is  a  contractually  convenient, 
cost  effective  means  to  produce  rapid 
authoritative  reports. 

Send  your  suggestions  and  other  re¬ 
plies  to  Dr.  Lawrence  Howell,  Associate 
Director  CSFRIAC  Program  Office,  AD 
Gi  l  1.  CSFRIAC,  Wright-PaltersonAFlLOH 
nt33-bS7j. 


Announcements 


Course  on  Human  Supervisory 
Control  Offered 

A  summer  course  on  Telerobotics,  Automa¬ 
tion,  and  Human  Supervisory  Control  is 
being  taught  August  17-21,  1992  by  the  Massa¬ 
chusetts  Institute  of  Technology.  This  course 
will  demonstrate  the  application  of  human  su¬ 
pervisory  control  to  semi-automated  systems. 
These  systems  include  robotic  arms  and 
vehicles  for  space,  undersea,  toxic  environ¬ 
ment  cleanup,  manufacturing,  mining,  surveil¬ 
lance,  and  medical  applications.  The  course 
will  benefit  system  engineers  whose  designs 
include  human  operators  in  the  role  of  supervi¬ 
sory  decision-maker/controller;  human  factors 
professionals  who  want  the  latest  informa¬ 
tion  on  modeling  and  designing  for  human- 
computer  interaction;  and  research  and 
design  managers  who  want  to  better  under¬ 
stand  the  challenges  and  problems  of  integrat¬ 
ing  the  human  operator  into  automated 
systems.  The  principal  lecturer  is  Thomas 
B.  Sheridan,  Professor  of  Engineering  and  Ap¬ 
plied  Psychology,  and  Director  of  the  Man- 
Machine  Systems  Laboratory  in  the  Depart¬ 
ment  of  Mechanical  Engineering.  For  further 
information  on  this  course,  contact  Prof. 
Frederick  J.  McGarry,  Director,  Office  of  the 
Summer  Session,  Room  El 9-356,  Massachusetts 
Institute  of  Technology,  Cambridge,  MA 
02139;  (617)  253-2101. 


Anthropometry  Class  Offered 

Did  you  know  there  is  no  such  thing  as  a  95th 
percentile  man  and  that  it  is  impossible  to 
construct  a  being  that  is  95th  percentile  for  all 
measurements?  Did  you  know  that  using  5th  and 
95th  percentiles  can  actually  fit  much  less  than 
90%  of  a  population  and  can  cause  the  design  to 
cost  more  than  alternative  methods?  Would  you 
be  interested  in  a  class  which  would  explain 
these  and  other  pitfalls  in  anthropometry,  as  well 
as  detail  methods  which  work  better?  Such  a 
class  would  describe  the  latest  in  anthropometric 
methods  as  applied  to  the  design  and  evaluation 
of  cockpits  (workstations),  clothing  and  protec¬ 
tive  equipment,  including  the  latest  in  topo¬ 
graphic  and  volumetric  scanning  of  the  human 
body.  If  you  are  interested  in  such  a  class, 
please  respond  to  Wes  Grooms,  CSERIAC  Con¬ 
ference  Administrator,  at  (513)  255-4842  or  DSN 
785-4842. 

New  Journal  on  Teleoperator  and  Virtual- 
Environment  Systems 

MIT  Press  is  pleased  to  announce  its  first 
journal  dedicated  exclusively  to  the  field  of 
teleoperators  and  virtual  environments,  Pres¬ 
ence. :  Teleoperators  and  Virtual  Environments. 
The  complexity  of  the  human-machine  interface 
and  associated  environmental  interactions  affect 
an  operator’s  performance,  experience,  and  sense 
of  presence  in  both  teleoperator  and  virtual 


environment  systems.  Presence  attempts  to 
provide  an  understanding  of  these  interfaces  and 
interactions,  as  well  as,  the  underlying  design. 
The  Editors-in-Chief  are  Thomas  B.  Sheridan, 
Massachusetts  Institute  of  Technology,  and  Tho¬ 
mas  A.  Furness,  III,  University  of  Washington. 
Presence  is  published  quarterly.  Subscription 
rates  are  $50  for  individuals  and  $120  for  institu¬ 
tions.  Foreign  subscribers  should  add  $14  for 
postage  and  handling,  Canadian  subscribers  also 
add  7%  GST.  To  subscribe  to  Presence ,  please 
write  to  MIT  Press  Journals,  55  Hayward  St., 
Cambridge,  MA  02142;  (6l7)  253-2889. 

Decrease  in  CSERIAC  SOAR  Charge 

CSERIAC  has  periodically  published  state-of- 
the-art  reports  (SOARs)  on  a  variety  of  topics 
relevant  to  the  human  factors  community.  It  has 
been  CSERIAC’s  intent  to  simpy  recover  costs 
incurred  for  production  of  these  SOARs.  How¬ 
ever,  the  high  cost  of  contracting  various  experts 
to  write  these,  combined  with  the  high  cost  of 
printing,  has  resulted  in  SOARs  that  were  priced 
beyond  what  most  ergonomists,  psychologists, 
designers,  and  engineers  could  afford.  To  make 
the  CSERIAC  SOARs  more  readily  available  to 
professionals  in  the  field,  the  CSERIAC  Program 
Office  has  decreased  the  price  from  $75  to  $35, 
effective  immediately.  This  price  reduction  will 
apply  to  SOARs  already  published  as  well  as 
future  SOARs,  until  further  notice. 
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Armstrong  Laboratory  Colloquium  Series: 

Virtual  Ecology  of  Work  and  System  Design 

Jens  Rasmussen 


Editor's  note:  Following  is  an  abstract 
based  on  Prof.  Rasmussen ’s presentation  as 
the  second  speaker  in  the  Armstrong  Labo¬ 
ratory  Colloquium  Series :  The  Human- 
Computer  Interface.  Dr.  Aaron  Schopper, 
CSERIAC  Chief  of  Technical  Services  and 
Analyses,  prepared  this  abstract. 

Oow  can  we  design  informa¬ 
tion  systems  to  support 
work  in  organizations  func¬ 
tioning  within  a  rapidly  changing  tech¬ 
nological  environment  that  is  tied  to 
equally  rapid  changes  in  marketing 
conditions  and  company  policies?  In 
such  environments  there  frequently 
exist  an  immense  variety  of  options 
(“degrees  of  freedom”)  with  respect  to 
“what  to  do  when  and  how.”  When  a 
worker  (a  “human  actor”  who  is  a 
dynamic  being  that  is  both  goal  di¬ 
rected  and  adaptive)  is  placed  in  such 
an  environment,  it  becomes  a  combi¬ 
nation  that  is  extremely  complex  to 
assess.  To  develop  effective  informa¬ 
tion  support  systems  for  such  an  envi¬ 
ronment  is  a  very  demanding  task. 

To  understand  and  anticipate  the 
worker’s  behavior,  one  must  identify 
the  “constraints”  that  shape  behavior 
and  the  “subjective  performance  crite¬ 
ria”  that  he  or  she  applies  when  mak¬ 
ing  a  decision  regarding  work  perfor¬ 
mance.  Pertinent  to  the  issue  is  the  fact 
that  behavior  has  a  “prehistory”  that 
reflects  the  aggregate  effects  of  prior 
choices  and  decisions.  In  modern 
organizations,  there  is  often  very  little 
pertinent  prehistory  to  guide  the 
worker.  Work  environments  of  past 
organizations  were  often  bound  by 
tradition,  longstanding  rules,  and  pre¬ 
cedents  that  provided  the  worker  with 
the  contextual  information  to  assist 
him  or  her  in  making  a  decision.  In 
contrast,  there  are  apt  to  exist  far  fewer 
formal  rules,  and  much  less  time  for 


traditions  to  form  or  for  informal  rules 
to  develop  in  present-day  organiza¬ 
tions.  Consequently,  normative  rules 
and  advice  systems  frequently  are  in¬ 
adequately  developed  in  many  mod¬ 
ern  work  environments. 

To  meet  the  needs  of  the  worker, 
information  systems  must  represent 
the  existing  state  of  affairs  in  the  work 
environment  as  transparently  as  is  pos¬ 
sible  in  terms  of  the  objectives  to  be 
pursued  and  the  constraints  that  exist 
to  bound  his  or  her  domain  of  alterna¬ 
tives.  The  framework  to  be  pursued 
must  represent  both  the  physical  char¬ 
acteristics  of  the  work  environment  as 
well  as  the  subjective  interpretation  of 
same  by  the  “actors”  involved.  To  be 
able  to  effectively  anticipate  informa¬ 
tion  needs  and  behaviors,  the  frame¬ 
work  must  be  able  to  relate  and  trans¬ 
late  the  existing  physical  work  envi¬ 
ronment  to  descriptions  of  human  re¬ 
source  profiles  and  subjective  prefer¬ 
ences.  Additionally,  the  analysis  strat¬ 
egy  must  be  an  economical  one;  all 
possible  alternatives  cannot  be  identi¬ 
fied  and  evaluated.  One  must  develop 
an  analysis  strategy  that  converges  rap¬ 
idly  upon  a  delimited  set  of  alterna¬ 
tives.  To  accomplish  this  requires  a 
stepwise  narrowing  of  the  degrees  of 
freedom  available  to  a  worker.  This 
reflects  a  successive  process  of  delim¬ 
iting  the  alternatives  by  identifying  the 
topographic  aspects  of  the  physical 
workspace;  explicitly  identifying  the 
goals,  constraints,  means  (and  amount 
of  time  available)  to  the  actor;  and 
delimitating  the  decision  task  and  asso¬ 
ciated  mental  tasks  and  emotional  fac¬ 
tors. 

Albeit  all  possible  alternatives  can¬ 
not  be  analyzed,  the  decription  of  the 
work  territory  should  identify  the  en¬ 
tire  network  of  means-end  relations  for 
all  pertinent  activities.  The  means-end 
representation  is  structured  in  several 


levels  of  abstraction,  ranging  from  the 
physical  aspect  of  the  task  environ¬ 
ment,  through  descriptions  of  the  physi¬ 
cal  activities  and  processes,  and  more 
abstract  descriptions  of  concepts  and 
functions  (functionality/intentionality) 
used  to  set  priorities,  allocate  resources, 
and  compare  the  results  with  the  even 
;  more  abstract  goals  and  constraints 
formulated  at  the  upper  levels.  An 
important  feature  of  this  complex 
means-end  hierarchy  is  the  resulting 
many-to-many  mapping  found  among 
the  levels,  a  feature  that  admits — and 
creates  the  need  for — the  complex 
information  support  systems  required 
to  support  efficient,  safe  work  environ¬ 
ments  in  modern  organizations. 

To  build  an  appropriate  framework 
and  accommodate  such  a  variety  of 
means-end  relationships  is  a  complex 
<  endeavor  necessitating  changes  in  the 
level  of  abstraction.  Albeit  such  changes 
entail  shifts  in  both  the  concepts  and 
the  structure,  the  different  levels  repre¬ 
sent  information  about  the  same  physi¬ 
cal  world.  At  each  level  of  abstraction, 
the  information  serves  as  a  set  of  links 
between  the  representation  of  the 
material  work  environment  and  its  re¬ 
sources  on  the  one  hand,  and  the 
representation  of  the  ultimate  goals 
and  objectives  on  the  other.  Thus  the 
means-end  hierarchy  is  formed  by  a 
progressive  set  of  conceptual  transfor¬ 
mations  reflecting  the  purposes  and 
intentions  at  the  higher  levels,  and  the 
physical  constituents  at  the  lower  end 
(see  Table).  The  critical  human  func¬ 
tion  at  each  level  is  that  of  decision 
making — a  task  that  focuses  on  the 
need  to  identify  and  resolve  discrepan¬ 
cies  between  the  existing  functional 
state  of  affairs  and  the  intentions  de¬ 
rived  from  the  ultimate  goals. 

In  terms  of  implications  for  system 
designers,  it  is  apparent  that  when 
tasks  have  large  discretionary  compo- 


March/ April  1992 


GATEWAY 


Decision  Making  Modes 


■  Rational,  analytical  reasoning;  situation  analysis,  goal 
evaluation,  decision,  and  planning 

■  Know-how,  choice  among  perceived  alternatives  in 
context;  dynamic  control  of  work  environment 

■  Define  increasingly  specific  context;  decision  evolves 
without  choice 


nents,  the  utility  of  the  application  of 
the  more  traditional  task  analysis  ap¬ 
proach  is  questionable.  Such  applica¬ 
tions  yield  the  greatest  benefit  in  closely 
coupled  systems  wherein  task  compo¬ 
nents  are  bound  in  rather  strict  closely 
bound  sequences  (e.g. ,  manufacturing 
processes).  In  instances  of  loosely 
coupled  tasks  (e.g.,  the  operation  of  a 
city),  where  the  intentional  (versus  the 
functional)  constraints  are  most  relevant, 
the  complexity  is  increased  markedly. 
While  it  is  hoped  that  intentions  can  be 
explicitly  communicated,  it  is  often  the 
case  that  “intentionality”  must  be  in¬ 
ferred  by  the  workers  via  their  judg¬ 
ments  of  their  co-workers’  behaviors 
and  communications  (often  non-verbal 
and  informal).  Thus  the  discernment 
and  interpretation  of  the  “intentional” 
communications  pose  the  greatest  prob¬ 
lem  for  the  designer  of  information 
support  systems. 

he  interpretation  of  intentions  and 
cause  by  a  worker  depends,  in  large 
part,  upon  the  mental  strategies  ap¬ 
plied.  The  choice  of  strategy  depends 
upon  the  competence  and  performance 
criteria  of  the  individual.  Such  strate¬ 
gies  range  from  very  formal  ones, 
which  define  the  extent  of  the  cogni¬ 
tive  load  imposed,  to  the  more  “natu¬ 
ral”  strategies  applied  in  everyday  work 
situations  which  entail  very  frequent 
shifts  among  the  brief  applications  of 
formal  strategies  in  response  to  very 


different  subjective  and  situation-de- 
pendent  factors  (e.g.,  time  required 
versus  time  available,  availability  of  a 
mental  model,  number  of  observations 
required  to  use  the  strategy).  Such 
shifts  in  strategies  represent  very  effec¬ 
tive  ways  of  circumventing  local  road¬ 
blocks  along  the  path  of  work.  Infor¬ 
mation  support  systems  should  sup¬ 
port  all  the  strategies  relevant  to  a  task 
to  permit  workers  to  shed  mental  work 
load  via  shifts  among  strategies. 

In  familiar  circumstances,  interac¬ 
tion  is  based  on  real-time,  multivari¬ 
able,  synchronous  coordination  of 
physical  movements  with  a  dynamic 
environment.  Automatic  action  pat¬ 
terns  are  activated  and  chained  by  cues 
perceived  as  signs;  no  choice  among 
alternatives  is  required.  When  the 
situation  demands  more  cognitive  ef¬ 
fort,  decisions  and  actions  are  based  on 
rules,  which, in  turn,  are  predicated  on 
the  invocation  and  updating  of  an 
internal  model  of  the  work  situation. 
The  result  of  comparisons  between  the 
perceptions  of  the  real  world  and  the 
internal  model  form  the  basis  for  re¬ 
sponse.  An  important  point  for  the 
designers  of  interfaces  is  that  when  a 
skilled  professional  encounters  a  mis¬ 
match  between  an  intuitive  expecta¬ 
tion  and  the  present  state  of  affairs,  he 
does  not  enter  a  general  problem¬ 
solving  mode.  Instead  he  or  she  per¬ 
ceives  only  a  limited  set  of  alternatives 


for  action.  Such  decision  makers  are 
not  subject  to  “information  input”  from 
an  environment  that  has  to  be  ana¬ 
lyzed;  they  are  asking  very  specific 
questions.  Experts  will  need  no  more 
information  than  is  needed  to  resolve 
the  choice  among  their  limited  set  of 
perceived  options.  Designers  who 
are  not  thoroughly  familiar  with  a 
work  domain  often  overestimate  the 
amount  of  information  required  by  a 
specialist  to  make  a  decision.  Yet,  at 
the  same  time,  they  tend  to  underesti¬ 
mate  the  complexity  of  a  display 
which  is  acceptable  to  an  expert  im¬ 
mersed  in  the  work  context  if  it  is 
properly  structured. 

Displays  required  to  support  skilled 
routines  should  be  structured  in  a  man¬ 
ner  that  isomorphically  depicts  the  part- 
whole  repertoire  of  automated  sensori¬ 
motor  patterns.  Those  designed  to 
support  ruled-based  behaviors  should 
provide  consistent  one-to-one  mapping 
between  work  constraints  and  the  cues 
and  signs  needed  to  release  familiar 
actions.  Displays  that  are  to  serve  the 
needs  of  those  engaged  in  problem 
solving  should  depict  the  work  domain 
as  an  abstraction  to  serve  as  an  external¬ 
ized  mental  model  that  will  support 
knowledge-based  action  and  planning. 

When  tasked  with  supporting  deci¬ 
sion  makers  regarding  discretionary 
tasks  within  dynamic  work  environ¬ 
ments,  it  is  generally  more  effective  to 
design  interfaces  that  display  the  con¬ 
straints  and  the  options  available  than 
it  is  to  offer  procedural  guides,  just  as 
it  is  more  effective  to  provide  maps  to 
a  navigator  than  it  is  to  provide  specific 
route  instructions  when  faced  with 
changing  targets  and  goals  in  the  face 
of  unknown  potential  roadblocks. 

For  potentially  high-hazard  systems, 
e.g.,  industrial  process  plants,  design 
priorities  for  decision  support  systems 
are  related  to  performance  in  the  rare 
situations  of  disturbance  punctuating 
long  periods  of  stable  automatic  opera¬ 
tion.  In  that  circumstance,  the  aim  of 
interface  design  is  to  provide  informa¬ 
tion  systems  and  displays  that  can 
support  skill  and  rule-based  perfor- 
Continued  on  page  10 
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mance  during  normal  operations  and, 
at  the  same  time,  can  serve  knowl¬ 
edge-based  analysis  during  distur¬ 
bances.  In  well-structured  systems,  the 
diagnosis  associated  with  disturbance 
control  can  be  effectively  accomplished 
by  using  strategies  that  assist  in  the 
process  of  comparing  the  actual  state 
of  the  system  with  the  normal,  in¬ 
tended  state  in  an  effort  to  locate  the 
location  of  the  disturbance  within  the 
relational  network.  Visual  support  of 
such  diagnosic  efforts  can  be  provided 
by  a  display  that  overlays  actual  and 
intended  states  at  different  levels  of 
representation.  The  intended  operat¬ 
ing  states  and  the  boundaries  of  unac¬ 
ceptable  operation  should  be  repre¬ 
sented  by  an  overlay  of  the  functional 
structure  and  states.  The  levels  of 
abstraction  employed  will  differ  as  well. 
At  the  global  level,  the  composition 
should  reflect  the  overall  structure;  at 
the  lower  levels,  the  composition  should 
map  closely  to  actions  on  physical 
items  or  elements  (whose  form  should 
match  population  stereotypes).  At  the 
intermediary,  configural  level,  activity 
is  related  to  functional  relations  for 
which  stereotypic  representations  are 


frequently  found  within  the  drawings 
contained  in  manuals  and  texts  associ¬ 
ated  with  the  profession.  An  experi¬ 
mental  example  of  such  a  display  is 
provided  in  the  figure  for  a  nuclear 
power  reactor. 

The  approach  I  have  described  here 
is  conceptually  compatible  with  the 
approach  developed  at  the  Armstrong 
Laboratory  with  AKADAM.  In  both 
cases,  the  need  has  been  realized  for  a 
method  to  represent  the  complexity 
and  degrees  of  freedom  found  in  ad¬ 
vanced  human-machine  systems,  while, 
at  the  same  time,  structured  formal¬ 
isms  such  as  SADT  and  EIDEF  repre¬ 
sentations  are  found  useful  for  system 
specifications. 

One  major  difference  in  focus  of 
the  two  approaches  offers  a  promising 
potential  for  joint  development.  The 
AKADAM  approach  focuses  on  an 
analysis  and  representation  of  the  us¬ 
ers  ’  knowledge  base  and  a  large  data¬ 
base  from  analysis  of  pilots’  concept 
maps  is  established.  The  new  inter¬ 
pretation  tools  being  developed 
greatly  facilitate  analysis  from  different 
user  perspectives  as  found  in  different 
task  situations. 


I  have  focused  my  approach  on  the 
identification  of  the  behavior-shaping 
constraints  in  a  task  situation  from  an 
analysis  of  the  actual  work  environ¬ 
ment  and  the  intentional ity  of  the  de¬ 
signers  and  found  an  integration  of  the 
RISO  framework  for  cognitive  work 
analysis  and  the  AKADAM  approach  to 
be  very  promising  for  an  explicit  de¬ 
scription  of  the  propagation  of  behav¬ 
ior-shaping  constraints  (in  terms  of 
functional  as  well  as  intentional  rela¬ 
tionships)  from  the  designer,  through 
training  of  system  users/operators 
and  their  subsequent  adaptation  to 
the  work  requirements,  onto  their 
knowledge  base. 

In  conclusion,  I  suggest  that  an 
integration  of  the  two  approaches 
could  serve  prediction  of  user  responses 
to  new  work  systems  and  interface 
designs  and,  therefore,  to  generalize 
the  results  from  aviation  and  pilot 
studies  to  be  used  more  widely  in  the 
civil  industry.  • 

Jens  Rasmussen  is  a  Professor  of  Cognitive 
Engineering  at  the  RISO  National  Labora¬ 
tory,  and  the  Technical  University  of 
Copenhagen,  Denmark. 
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Armstrong  Laboratory  Colloquium  Series: 

A  Conversation  with  Jens  Rasmussen 


Editor's  note:  The  following  is  an  edited 
transcript  of  a  conversation  with  Professor 
fens  Rasmussen,  RISC )  National  Laboratory 
and  the  Technical  University  of 
Copenhagen,  Denmark,  who  had  just  made 
a  presentation  as  the  second  speaker  in  the 
Armstrong  Laboratory  Colloquium  Series: 
The  Human-Computer  Interface.  The  in¬ 
terviewers  were  Dr.  Lew  Hann,  CSERIAC 
COTR,  and  Dr.  Aaron  Schopper,  CSERIAC 
Chief  of  Technical  Services  and  Analyses. 


OSERIAC: 

I  notice  that  your  affiliation 
at  the  institute  is  with  the 
Cognitive  Engineering  Department. 
Could  you  explain  how  “cognitive  en¬ 
gineering”  is  related  to  human  factors 
or  ergonomics? 

Prof.  Rasmussen: 

We  call  it  Cognitive  Engineering 
to  avoid  the  term  “human  factors,” 
which,  to  us,  is  more  related  to  coming 
in  as  experts  and  making  refinements 
to  an  existing  interface.  Cognitive  En¬ 
gineering  on  the  other  hand,  deals 
more  with  designing  information  sys¬ 
tems  so  that  the  basic  structure  and 

functioning  of  the  sys-  - 

tern  serve  the  user. 

That  is,  human  fac-  The  problem  I 

tors  normally  is  seen  {fog  capablMti 

as  a  kind  of  craft 

where  experts  are  adapted  tO  th 

called  in  to  help  sort  - 

out  problems,  where-as  cognitive  en¬ 
gineering  is  a  cross-disciplinary  ap¬ 
proach  to  a  design  problem. 

CSERIAC: 

I  read  recently,  following  the  third 
crash  of  an  Airbus  A320,  that  pilots 
are  talking  about  refusing  to  fly 
this  aircraft.  The  A320,  as  you  know, 
has  a  highly  computerized  cockpit, 
with  multi-purpose  displays.  The  issue 
here  seems  to  be  one  of  “trust”  in 
the  system.  I  understand  you  have 


been  looking  at  this  problem. 

Prof.  Rasmussen: 

I  think  it  is  a  very  important  issue.  We 
have  been  discussing  making  these 
kinds  of  information  systems,  and  that 
they  should  be  adaptive  to  the  user.  One 
of  the  problems  is  that  we  are  losing 
people’s  confidence;  if  people  don’t 
understand  what  is  going  on  behind  an 
automatic  system,  they  lose  trust. 

CSERIAC: 

One  of  the  pilot’s  complaints  about 
the  A320  is  that  the  system  doesn’t 
permit  violent  flight  maneuvers.  Nor¬ 
mally  this  is  desirable,  but  in  the  case  of 
an  emergency,  such  extreme  control 
inputs  might  be  necessary. 

Prof.  Rasmussen: 

The  designer  should  protect  his  de¬ 
sign  by  putting  constraints  on  the  pilot, 
but  should  also  be  sensitive  to  the  fact 
that  the  pilot  sometimes  has  other  priori¬ 
ties  which  might  require  going  beyond 
the  constraints.  That’s  the  reason  we  are 
working  so  hard  on  these  ecological 
displays.  You  must  make  the  boundaries 


The  problem  is  to  find  out  how  to  design  a  system  so  that  it  matches 
the  capabilities  and  preferences  of  the  persons  when  they  have 
adapted  to  the  system. 


been  trying  to  convey  over  the  years. 
When  you  talk  of  “adaptation”  are  you 
using  it  in  the  sense  of  the  person 
adapting  to  the  system,  or  the  reverse? 

Prof.  Rasmussen: 

It  is  not  so  simple  to  define  it  in  either 
extreme.  I  think  you  should  make  it 
possible  for  the  system  and  the  person 
to  “meet”  somewhere  in  the  middle.  If 
one  talks  about  fitting  the  system  to  the 
person,  it  should  be  designed  to  fit  the 
person  as  he  will  be  after  he  has 
adapted  to  the  characteristics  of  the 
system.  You  want  to  make  a  system 
where  people  adapt  to  an  effective 
way  of  operating  based  on  their  pref¬ 
erences;  but  this  does  not  mean  you 
are  fitting  the  system  to  the  person. 
Whatever  you  do,  the  person  will  adapt 
to  your  design;  after  working  in  the 
system  for  a  while  they  are  always 
different  from  when  they  started.  The 
problem  is  to  find  out  how  to  design  a 
system  so  that  it  matches  the  capabili¬ 
ties  and  preferences  of  the  persons 
when  they  have  adapted  to  the  system. 
User  opinions  have  value,  but  system 
design  should  not  be  based  on  that 

_  alone.  More  important 

are  the  implicit  aspects 

iat  it  matches  such  as  subconscious 

en  they  have  preferences, valuestruc- 

tures,  and  resources. 


of  the  system  visible  to  the  user,  but  we 
don’t  think  you  should  constrain  them  to 
be  within  the  intention  of  the  designer, 
if  you  can  identify  situations  where  other 
priorities  are  operating. 

CSERIAC: 

Much  to  the  consternation  of  many 
ergonomics  practitioners,  a  recent  au¬ 
tomobile  advertisement  in  American 
television  defined  ergonomics  as  “fit¬ 
ting  the  person  to  the  machine.”  This  is, 
of  course,  the  opposite  of  what  we  have 


-  CSERIAC: 

Dr.  Gary  Klein  has  been  doing  exten¬ 
sive  work  in  naturalistic  decision  mak¬ 
ing.  I  understand  you  are  also  working 
in  this  area.  How  did  you  get  involved, 
and  why  do  you  feel  it  is  important? 

Prof.  Rasmussen: 

We  arrived  at  the  problems  sur¬ 
rounding  naturalistic  decision-making 
independently  of  Gary  Klein  and  his 
associates.  It  evolved  from  our  error 
studies,  where  we  found  in  many  situ- 
Continued  on  page  12 
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ations  people  were  running  into  prob¬ 
lems,  because  they  were  making  a 
decision  based  on  some  cues  in  the 
environment  which  are  not  relevant. 
We  found,  as  we  studied  adaptation, 
that  although  people  are  supposed  to 
attend  to  all  the  information  defining 
the  attributes  of  the  decision  to  be 
made  and  the  action  to  take,  they  in 
fact  take  the  path  of  least  resistance. 
That  is,  they  usually  consider  only  a 
couple  of  options  based  on  the  con¬ 
text.  Most  decision-making  situations 
are  occurring  in  a  continuous  task 
setting,  where  the  person  is  very  famil¬ 
iar  with  the  context,  and  they  know 
pretty  well  how  many  options  they 
have  to  choose  from  in  any  decision 
situation.  In  any  given  context  you 
only  ask  for  the  cues  which  will  give 
you  the  choice;  you  only  need  one  bit 
of  information  to  choose  between  two 
alternatives.  Ecological  interfaces  pro¬ 
vide  this  kind  of  information. 

CSERIAC: 

Based  on  your  long  experience  in 
the  field  of  ergonomics,  where  do  you 
think  we  should  be  investing  our  re¬ 
sources  for  the  greatest  payoff? 


Scenes  from  the  Armstrong  Laboratory  Colloquium  Series: 


Professor  Rasmussen  lectured  in  the  auditorium  of  Building  441 \  the  Bioacoustics  Laboratory 
of  the  Crew  Systems  Directorate ,  Armstrong  Laboratory ;  Wright-Patterson  Air  Force  Base. 
Photo  by  Dan  Churchill. 


Prof.  Rasmussen: 

I  really  think  some  resources  should 
be  invested  in  getting  some  cross- 
disciplinary  research  going.  I  think  it’s 
so  important  to  have  some  studies 
going  on  where  you  have  experts  from 
various  domain  areas  working  simulta¬ 
neously  on  a  problem.  So,  for  example, 
you  might  have  an  expert  studying 
behavior-shaping  constraints,  a  cogni¬ 
tive  psychologist  looking  at  naturalistic 
decision-making,  and  a  perception 
psychologist  examining  the  problem 
of  direct  perception  of  invariants  in  the 
environment.  In  this  way,  you  could 
get  a  more  integrated  basis  for  discuss¬ 
ing  matching  systems  to  people.  It  is 
not  a  nice  academic  research  problem 
which  we  can  resolve  in  a  short  time 
with  a  professor  and  graduate  student. 
By  the  way,  in  this  respect,  I  think  that 
the  Armstrong  Laboratory  here  has  the 
right  capability  to  pursue  such  research. 
You  can  make  long-term  plans,  which 
is  impossible  in  academia,  and  you  can 
conduct  cross-disciplinary  projects  in 
complex  settings.  • 
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IDEA: 

The  HSI/HFE  Integrated  Decision/Engineering  Aid 

DeanP.  Westerman 
Christopher  C.  Heasly 
Daniel  L.  Welch 


Oast  year  the  Department  of 
Defense  approved  DoD 
Directive  5000.1  and  DoD 
Instruction  5000.2.  These  documents 
formalize  Systems  Acquisition  Policies 
and  implementation  of  Human  Sys¬ 
tems  Integration,  or  HSI  as  it  has 
become  known.  The  requirements 
are  driven  by  the  need  to  develop 
systems  that  “...meet  the  operational 
user’s  needs...” 

The  objectives  and  focus  of  HSI 
draw  upon  the  U.S.  Army’s  MANPRINT 
initiative  in  that  both  programs  recog¬ 
nize  the  need  and  benefit  of  consider¬ 
ing  the  “user”  as  an  integral  component 
of  the  system. 

Integrated  Decision/Engineering  Aid 
(IDEA)  is  an  automated  system  devel¬ 
oped  by  the  U.S.  Army  Human  Engi¬ 
neering  Laboratory,  U.S.  Naval  Space 
and  Warfare  Command,  the  U.S.  Naval 
Sea  Systems  Command,  and  Carlow 
International  Incorporated.  The  sys¬ 
tem  is  a  collection  of  integrated  tools 
used  in  support  of  Human  Factors 
Engineering  analyses.  Originally  de¬ 
veloped  for  standardizing  MANPRINT 
activities  within  the  U.S.  Army  Human 
Engineering  Laboratory,  it  is  being 
updated  to  reflect  the  requirements  of 
DoD  Directive  5000.1  and  DoD  In¬ 
struction  5000.2. 

IDEA  is  currently  implemented  on 
the  Macintosh  family  of  computers 
(select  portions  of  IDEA  are  to  be 
converted  for  use  on  DOS  machines). 

IDEA  provides  an  HFE/HSI  analyst 
with  the  guidelines,  data,  and  tools 
required  to  integrate  HFE  into  acquisi¬ 
tions  of  non-developmental  items,  prod¬ 
uct  improvements,  and  new  system 


developments.  The  primary  focus  of 
IDEA  is  on  guiding  the  analyst  through 
the  steps  required  to  conduct  HSI/HFE 
activities,  and  on  automated  methods 
to  conduct  required  analyses.  Addi¬ 
tional  efforts  were  aimed  at  efficient 
use  of  data  throughout.  For  example, 
having  constructed  a  flow  diagram  of 
an  emerging  weapon  system,  an  ana¬ 
lyst  can  use  the  resulting  task  inventory 
in  no  fewer  than  five  other  analysis 
tools.  Not  only  does  this  reduce  the 
time  required  to  conduct  analyses,  it 
serves  to  integrate  the  analyses  (a  pri¬ 
mary  goal  of  both  MANPRINT  and  HSI) 
making  them  easier  to  interpret  (and 
presumably  more  rational). 

The  types  of  aides  include  Process 
Tools,  System  Notes,  Analytical  Tools, 


Information  Tools,  and  Productivity 
Tools.  Each  of  these  is  briefly  de¬ 
scribed  below. 

Process  Tools 

IDEA  is  organized  around  the  Mate¬ 
rial  Acquisition  Process  (MAP).  Each 
phase  of  the  MAP  (e.g.,  Mission  Needs 
Determination,  Concept  Exploration 
&  Definition)  is  represented  in  IDEA  as 
a  process.  The  highest  level  process, 
referred  to  as  the  phase ,  identifies  the 
relationships  between  discreet  or  re¬ 
lated  activities  defined  as  steps .  A  step 
in  turn  has  a  lower  level  or  more 
defined  set  of  activities  termed  sub¬ 
steps.  Finally,  each  sub-step  is  decom- 
Continued  on  page  14 


Figure  1 .  The  IDEA  Home  Card  permits  rapid  access  to  all  elements  of the  automated  system. 
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posed  into  a  series  of  activities.  An 
analyst  "‘navigates”  through  the  various 
levels  of  the  Process  by  “pointing”  and 
“clicking”  the  mouse.  Figure  1  shows 
the  Home  Card  which  is  the  starting 
point  for  the  system. 

These  activities  detail  the  required 
steps,  by  sub-steps,  sub-processes,  and 
activities  required  to  conduct  the  HSI/ 

HFE  analyses  for  that  specific  phase. 

The  Process  Tools  were  developed 
to  drive/support  the  use  of: 

•  System  Notes  Tool 

•  Productivity  Tools 

•  Analytical  Tools 

At  the  level  of  the  HSI/HFE  Process 
for  a  specific  phase  of  the  materiel 
acquisition  process  (MAP),  the  analyst 
is  presented  with  a  sequence  of 
interrelated  steps  which  constitute  the 
activities  and  activity  sequence  to  be 
accomplished  while  applying  HSI/ 

HFE  in  that  particular  phase.  Each 
step  of  this  process  is  a  button  which 
can  be  selected  by  the  analyst  to  ac¬ 
quire  additional  information  concern¬ 
ing  that  step. 

At  the  Step  level  (Fig.  2),  the  analyst 
is  presented  with  a  full  description  of  i 
the  selected  process  step.  The  ele¬ 
ments  of  the  description  are  controlled  j 
by  buttons  on  the  step  level  display. 

Selecting  the  step  button  itself  presents 
an  overview  of  the  step,  including 
objectives  and  requirements.  The  “Re¬ 
lationship  to  the  MAP”  button  displays 
how  the  selected  step  is  related  to  the 
activities,  events,  and  products  of  the  : 
overall  MAP.  The  “Inputs”  and  “Out-  ; 
puts”  buttons,  when  selected,  display 
the  required  information  for  entry  to 
the  step  and  the  informational  prod¬ 
ucts  resulting  from  the  step.  The  j 
“Work  Summary”  button  displays  what 
steps  have  been  completed  in  the  ap¬ 
plication  of  HSI/HFE  for  that  particular  ! 
system  and  the  “Sub-Process”  button  i 
takes  the  analyst  deeper  into  the  pro¬ 
cess,  to  a  display  of  the  sequence  of 
sub-steps  for  that  particular  step. 

At  the  Sub-Process  level  (Fig.  3),  the 
analyst  is  presented  with  a  display  of  Figure  3-  Each  HFE/MANPRINT  step  can  be  further  described.  Clicking  on  any  box  on  this 

the  sequence  of  sub-steps  required  to  screen  will  provide  additional  information  on  inputs ,  required  activities,  and  output 

carry  out  the  process  step.  Each  sub-  products  for  each  subprocess. 

step  is  represented  by  a  button,  selec- 


Figure2.  Each  element  of  the  “ Step  ” screen  is  a  hot  field.  Clicking  on  any  element  will  provide 
additional  information  to  the  user  regarding  that  area. 
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tion  of  which  presents  additional  in¬ 
formation  and  guidelines  concerning 
the  sub-step.  When  the  analyst  selects 
a  sub-step  button,  a  display  presents 
the  inputs,  required  activities,  and 
products  of  that  particular  sub-step. 
Activities  include  the  specific  actions 
needed  to  perform  the  sub-step.  At  the 
Sub-Process  level,  the  analyst  can  se¬ 
lect  the  notebook,  which  provides 
the  capability  to  identify  and  record 
requirements  and  concerns  for  that 
sub-step.  The  notebook  represents 
a  report  generator  for  the  HSI/HFE 
application  for  the  system  under¬ 
development. 

System  Notes 

The  System  Notes  Tool  content  was 
developed  to  provide  a  centralized 
facility  in  which  all  documentation 
relevant  to  the  developing  system  is  to 
be  maintained.  The  tool  is  structured 
around  two  related  concepts. 

The  first,  an  assumption,  is  that  the 
HSI/HFE  Analyst  will  be  working  on 
several  systems  at  any  point  in  time, 
and  will  need  to  document  efforts 
separately.  Therefore,  the  analyst  is 
strongly  encouraged  to  keep  a  sepa¬ 
rate  notebook  for  each  system. 

The  second  issue  is  that  the  note¬ 
book  should  help  to  focus  the  analyst’s 
activities.  Accordingly,  the  System 
Notes  Tool  includes  all  the  activities 
required  to  complete  all  sub-process 
sub-steps  and  activities  for  all  steps  of 
each  phase.  Further,  the  activities 
listed  can  be  used  as  a  checklist  to 
verify  the  completeness  of  the  activi¬ 
ties/analyses. 

Analytical  Tools 

Analytical  Tools  currently  available 
to  facilitate  the  HSI/HFE  Analyst’s  ef¬ 
forts  include: 

•  IDEA  Comparability  Analysis  Tool 
(ICAN)  -  used  to  identify  high  driver 
tasks/conditions  and  lessons  learned 
from  predecessor  systems 

•  IDEA  Role-of-the-Soldier  Tool 
(IROS)  -  used  for  function  allocations 
and  determination  of  roles-of-the- 


soldier  in  system  operation  and 
maintenance 

•  IDEA  Automated  Critical  Task 
Analysis  Tool  (I-TASK)  -  used  to  con¬ 
duct  fundamental  HFE  critical  task 
analyses 

•  Functional  Flow/Task  Sequencing 
Tool  (NETWORK)  -  a  graphic  func¬ 
tional  flow/task  sequencing  tool  used 
to  establish  the  relationships  among 
tasks  especially  developed  as  a  front- 
end  to  SIMWAM 

•  Simulation  for  Workload  Assess¬ 
ment  and  Modeling  (SIMWAM)  -  simu¬ 
lation  model  for  assessing  multi-opera¬ 
tor  task  networks  and  evaluating  alter¬ 
nate  role  of  man  concepts  and  system 
design  alternatives 

•  IDEA  Issue  Tracking  Tool  (ISSUE) 
-  used  for  monitoring  the  status  of 
specific  HSI/HFE  issues  throughout  the 
design  process 

•  IDEA  Tradeoff  Analysis  Tool 
(ITALIC)  -  used  to  proceduralize  tradeoff 
studies,  documenting  the  variables  and 
weighing  factors  used  in  the  study 

•  IDEA  Automated  HEDGE  T&E  Tool 
(I-HEDGE)  -  used  to  select  design  test 
criteria  from  the  Human  Factors  Engi¬ 
neering  Data  Guide  for  Evaluation 
(HEDGE)  and  to  maintain  an  elec¬ 
tronic  checklist 

•  IDEA  Safety  and  Health  Hazard 
Analysis,  Developer  and  Evaluator  (I- 
SHADE)  -  used  to  log  identified  haz¬ 
ards  and  to  maintain  an  audit  trail  of 
their  elimination  or  resolution. 

Information  Tools 

IDEA  includes  several  specialized 
data  sources  or  information  manage¬ 
ment  tools  to  assist  the  HSI/HFE  Ana¬ 
lyst  in  conducting  the  analyses  and 
activities  of  the  acquisition  process. 
Exemplar  information  tools  include: 

•  HSI/HFE  glossary  accessible  from 
any  location  in  IDEA 

•  an  automated  HSI/HFE  points-of- 
contact  information  system 

•  an  IDEA  automated  status  report¬ 
ing  system  for  each  materiel  system 
under  analysis 

•  abstracts  of  US  Army  Human  En¬ 
gineering  Laboratory  (USAHEL)  TMs, 


TNs  and  Letter  Reports 

•  an  information  system  containing 
surveys  of  all  known  HFE  tools  and 
models. 

Productivity  Tools 

Integrated  within  IDEA  is  a  collec¬ 
tion  of  specialized  tools  developed  to 
enhance  the  productivity  of  the  HSI/ 
HFE  Analyst,  including: 

•  a  hypertext  version  of  MIL-STD- 
1472D 

•  special  computational  aids  such  as 
visual  field-of-view  calculation  and 
anthropometries 

•  a  units  conversion  calculator 

•  a  means  of  accessing  standard 
office  productivity  software  (word  pro¬ 
cessing,  spreadsheet,  database,  etc.) 

Current  Developments 

IDEA  is  the  product  of  a  Small 
Business  Innovative  Research  (SBIR) 
program,  currently  in  Phase  III,  be¬ 
tween  the  US  Army  Human  Engineer¬ 
ing  Laboratory  (USAHEL),  Aberdeen, 
MD,  and  Carlow  International  Incor¬ 
porated  of  Falls  Church,  VA.,  with 
the  participation  of  the  US  Navy.  Phases 
I  and  II  developed  the  IDEA 
Process  through  Acquisition  Milestone 
1.  Phase  III  will  complete  the  process 
through  the  rest  of  the  acquisition 
process  and  is  scheduled  for  release 
in  1992.  IDEA  is  currently  under 
“Beta  Test”  at  USAHEL  field  offices 
and  at  the  British  and  French  Ministries 
of  Defense.  Points  of  contact  are 
Dean  P.  Westerman,  USAHEL,  (301)- 
278-2980,  and  Chris  Heasly,  Carlow 
International  Incorporated,  (703)- 
698-6225.  • 

Dean  P.  Westerman  leads  the  Human 
Factors  Automation  Office  at  USAHEL, 
Aberdeen,  MD,  and  is  the  IDEA  Project 
Officer .  Christopher  C.  Heasly  is  Vice  P 
resident  of  Development  at  Carlow  Inter¬ 
national  Incorporated,  Falls  Church,  VA. 
Daniel  L.  Welch,  Ph.D.,  is  Senior  Human 
Factors  Engineer  and  Manager  of 
Continuous  Process  Control  Systems, 
also  at  Carlow. 
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Meeting  the  Challenge  of  Peace: 

The  Reorganization  of  the  Armstrong  Laboratory 
Human  Engineering  Division 

Reuben  L.  Hann 


Ohe  Cold  War  has  ended. 

Military  installations  world¬ 
wide  have  been  scheduled 
for  closing.  Thousands  of  active  duty 
and  reserve  military  personnel  are  be¬ 
ing  encouraged  to  retire  or  are  being 
separated  early.  This  downsizing  of  j 
our  fighting  forces,  combined  with  the 
difficult  economic  times,  has  put  pres¬ 
sure  on  the  DoD  laboratory  system  to  * 
shrink  and  combine  programs  accord¬ 
ingly.  Coupled  with  this  pressure  is  the 
clear  need —  as  a  result  of  the  stunning 
successes  in  Desert  Storm — to  main¬ 
tain  a  technological  superiority  during 
times  of  peace.  We  must  prevent  tech¬ 
nological  surprise  by  potential  adver¬ 
saries,  exploit  scientific  breakthroughs, 
and  develop  an  array  of  technologi¬ 
cally  superior  options  for  detecting 
aggression  or  to  successfully  conclude 
a  conflict. 

Some  Organizational  Background 

The  Air  Force  has  responded  to  this  I 
new  environment  by  reorganizing  the 
previous  14  laboratory  organizations 
into  four  “superlabs.”  These  all  reside 
in  the  Air  Force  Systems  Command 
(which  will  be  incorporated  into  the 
Air  Force  Materiel  Command  in  July  1 
1992),  and  are  aligned  with  the  four 
“product”  divisions:  Aeronautical  Sys¬ 
tems  Division,  Electronic  Systems  Divi¬ 
sion,  Space  Systems  Division,  and  j 
Human  Systems  Division. 

The  Human  System  Division  (HSD)  | 
is  the  home  of  the  Armstrong  Labora¬ 
tory  (AL),  the  “superlab”  responsible 
for  all  R&D  involving  the  human  in  the 
Air  Force  environment.  AL  is  located  at 
Brooks  Air  Force  Base,  San  Antonio, 
Texas  and  is  organized  into  four  direc-  ' 
torates:  Aerospace  Medicine,  Human 


Resources,  Occupational  and  Environ-  i 
mental  Health,  and  Crew  Systems. 

The  Air  Force  Aerospace  Medical 
Research  Laboratory,  later  renamed  the 
Armstrong  Aerospace  Medical  Labora¬ 
tory,  is  no  more.  The  facilities  and 
personnel  at  Wright-Patterson  Air  Force 
Base  are  now  a  part  of  the  AL  Crew 
Systems  Directorate  (AL/CF).  The 
Human  Engineering  Division,  whose 
name  has  not  changed,  is  one  of  three 
technical  divisions  under  CF  and  has 
the  official  symbol  CFH. 

The  Human  Engineering  Division 

The  Human  Engineering  Division 
(HE)  has  a  long  and  distinguished 
history,  dating  back  to  1945,  when  it 
was  established  as  the  Psychology 
Branch  of  the  Aero  Medical  Labora¬ 
tory.  Its  founder  and  first  Chief  was 
Paul  M.  Fitts,  a  pioneering  figure  in 
experimental  psychology  research.  He 
is  credited  with  having  organized  and 
directed  the  first  major  Air  Force  effort 
in  the  field  of  human  engineering.  The 
Human  Engineering  laboratory  build-  1 
ing  now  bears  his  name,  as  a  result  of 
memorialization  in  1985. 

he  was  established  as  a  Division  in 
1968,  and  has  had  three  Chiefs:  Dr. 
Julien  Christensen  (1968-1974),  Mr.  | 
Charles  Bates  (1974-1991),  and  the 
present  Chief,  Dr.  Kenneth  R.  Boff, 
who  assumed  the  leadership  in  April 
1991. 

In  light  of  the  changing  world  situa-  1 
tion  and  the  resulting  overall  military 
reorganization  activities,  Dr.  Boff  de-  , 
termined  that  HE  would  have  to  be 
restructured  to  better  meet  the  chal¬ 
lenge  of  continuing  to  provide  the  kind 
of  high-quality  human  engineering  R&D 
and  field  support  that  the  Division  had 


provided  in  the  past.  He  reorganized 
the  Division  by  redefining  branch  mis¬ 
sions  and  shifting  some  personnel  be¬ 
tween  branches. 

Dr.  Boff  redefined  the  HE  branch 
missions  with  three  goals  in  mind. 
First,  he  wanted  to  balance  the  re¬ 
search  and  development  sides  of  each 
branch’s  activities.  Second,  he  sought 
to  improve  the  quality  and  focus  of 
each  branch’s  science  and  technology 
by  creating  teams  of  scientists  and 
engineers  with  complementary  skills. 
In  this  way,  the  Division  would  be 
better  able  to  sustain  and  nurture  the 
quality  of  its  personnel  and  be  in  a 
better  position  to  attract  new  scientists 
when  hiring  opportunities  occur.  Last, 
he  wanted  to  build  a  reputation  for 
doing  credible  science,  while  balanc¬ 
ing  this  with  the  needs  of  DoD  and 
industry  users. 

To  accomplish  this,  Dr.  Boff  felt  that 
the  HE  Division  should  take  advantage 
of  its  unique  research  capability  to 
study  human  performance  in  complex 
system  environments.  While  academic 
institutions  are  usually  well  equipped 
to  study  basic  research  problems  in  the 
area,  they  do  not  have  the  technical 
facilities  to  handle  complex  human/ 
machine  system  studies,  or  the  inclina¬ 
tion  to  pursue  such  research,  given  the 
time  pressures  of  the  academic  calen¬ 
dar.  HE  has  the  advantage  of  a  much 
greater  range  of  resources  to  apply  to 
the  problem,  thus  providing  the  op¬ 
portunity  to  explore  more  complex 
situations.  This  is  mainly  attributable  to 
1)  the  availability  of  advanced  simula¬ 
tors  and  other  sophisticated  technolo¬ 
gies,  and  2)  a  multi-disciplinary  profes¬ 
sional  staff  with  extensive  experience, 
who  is  not  working  against  a  “publish- 
or-perish”  timetable. 
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The  staff  and  facilities  of  the  HE 
Division  are  organized  into  five 
branches:  1)  Ergonomics  Analysis,  2) 
Design  Technology,  3)  Crew  Systems 
Integration,  4)  Performance  Assessment 
&  Interface  Technology,  and  5)  Visual 
Display  Systems.  A  brief  description  of 
the  branches  with  examples  of  their 
activities  follows  (see  fig.). 

Ergonomics  Analysis  Branch 
(CFHA) 

The  Ergonomics  Analysis  Branch  acts 
as  a  portal  for  the  flow  of  technical 
information  and  data  to  and  from  the 
Division.  It  processes  and  manages  the 
transition  of  HE-developed  models, 
data,  and  technology  to  the  outside 


world,  principally  through  the  Crew 
System  Ergonomics  Information  Analy¬ 
sis  Center  (CSERIAC),  which  it  directs. 

The  Ergonomics  Analysis  Branch  is 
focusing  on  multi-media  communica¬ 
tions  as  another  way  to  promote  the 
transfer  of  information.  It  is  building  a 
multi-media  conferencing  center  to  pro¬ 
vide  for  the  enhanced  communication 
of  HE  products  and  information. 

CFHA  also  provides  analysis  in  the 
special  area  of  nuclear,  biological,  and 
chemical  (NBC)  weapon  threats. 
Through  its  NBC  Operability  Assess¬ 
ment  Program,  branch  scientists  were 
able  to  provide  an  in-depth  vulnerabil¬ 
ity  assessment  of  Air  Force  personnel 
in  Operation  Desert  Storm  for  specific 


Iraqi  chemical  and  biological  agents, 
and  delivery  systems.  This  type  of  data 
is  invaluable  for  the  identification  and 
development  of  NBC  protective  de¬ 
vices  and  procedures. 

Design  Technology  Branch 
(CFHD) 

The  emphasis  of  the  Design  Tech¬ 
nology  Branch  is  in  providing  assis¬ 
tance  to  designers  for  incorporating 
human  system  information  in  the  pro¬ 
cess  and  product  of  their  design  efforts. 
This  is  accomplished  by  converting 
research  publications  and  data  into  a 
form  which  is  truly  useful  for  designers 
and  engineers.  The  output  of  this  pro¬ 
cess  is  a  collection  of  principles,  tools, 
standards,  and  methodologies  which 
enable  the  designer  to  account  for  the 
needs,  capabilities,  and  limitations  of 
the  human  in  a  crew  system  environ¬ 
ment. 

CFHD  scientists  have  been  studying 
the  crew  station  design  process  itself, 
to  try  to  isolate  those  aspects  of  the 
activity  where  human  factors  principles 
could  be  applied  for  the  benefit  of  the 
designer  in  the  way  he  approaches  his 
task — the  human  factors  of  design,  if 
you  will.  Being  able  to  visualize  the 
effects  of  design  alternatives  early  in 
the  process  has  been  found  to  be  a 
valuable  capability.  As  a  result,  a  tool  is 
presently  under  development  which 
will  provide  the  ability  to  visualize  and 
prototype  human  factor  considerations 
in  a  computer-aided  design  environ¬ 
ment.  It  is  expected  to  have  consider¬ 
able  impact  on  the  design  community. 

Crew  Systems  Integration  Branch 
(CFHI) 

There  has  been  an  increasing 
trend  for  military  laboratories  to  get 
involved  in  more  direct  support  of 
applications  problems  in  the  field. 
However,  for  the  Crew  Systems  Inte¬ 
gration  Branch  this  has  always  been  a 
major  part  of  their  activity.  Originally 
CFHI  was  involved  almost  exclusively 
with  human  factors  problems  in 
bomber  aircraft.  Today  they  provide 
support  for  fighter,  transport,  and 

Continued  on  page  18 
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helicopter  aircraft,  as  well  as  ground- 
based  crew  systems. 

Due  partially  to  shrinking  budgets, 
there  has  been  an  emphasis  among 
military  planners  on  modernizing  elec¬ 
tronic  equipment  in  existing  aircraft, 
rather  than  spending  money  on  totally 
new  systems.  This  retrofitting  process 
presents  a  whole  array  of  new  ergo¬ 
nomic  problems  for  the  crew  mem¬ 
bers.  Good  ergonomic  design  is  a  re¬ 
sult  of  an  integrated  approach  during 
original  system  design;  but,  when 
modern  equipment  is  being  retrofitted 
in  older  aircraft,  it  requires  extra  effort 
with  human  factors  support  to  ensure 
an  efficient,  usable  system.  CFHI,  with 
its  flight-qualified,  experienced 
observers,  is  equipped  to  provide 
such  assistance. 

An  important  additional  function  of 
CFHI  is  that,  through  its  involvement 
with  field  units,  it  has  the  ability  to  test 
and  transition  new  technology  devel¬ 
oped  by  the  other  HE  branches.  This  is 
a  valuable  service,  both  for  the  Labora¬ 
tory  and  the  user  commands. 

Performance  Assessment  &  Interface 

Technology  Branch 

(CFHP) 

This  branch  performs  scientific  analy¬ 
sis  in  basic  human  performance-re¬ 
lated  capabilities  and  limitation  in  a 
system  context.  That  is,  the  human  is 
studied  as  a  part  of  a  larger  entity, 
which  includes  other  persons,  equip¬ 
ment,  and  situational  variables.  Included 
are  studies  in  situational  awareness, 
visual  performance,  and  cognitive 
workload. 

An  exciting  area  of  study  is  the 
application  of  advanced  interface  tech¬ 
niques  such  as  multi-media  3-D  visual 
and  auditory  displays.  A  related  area, 
which  is  receiving  a  lot  of  press  atten¬ 
tion  these  days,  is  the  use  of  virtual 
displays  and  controls,  in  which  the 
operator  is  placed  in  a  world  where  the 
control  panel  and  instruments  appear 
in  space  before  him,  and  he  is  able  to 
“touch”  and  operate  the  controls,  even 
though  they  are  not  physically  present. 
The  technology  has  matured  sufficiently 
to  plan  the  inclusion  of  such  systems  in 


|  the  near  future.  The  challenge  is  to 
:  determine  how  these  might  best  be 
utilized — if  at  all ;  it  is  not  always  appro¬ 
priate  to  incorporate  a  new  technology 
merely  because  it  exists. 

Visual  Display  Systems  Branch 
(CFHV) 

As  the  name  implies,  this  branch 
conducts  research  and  development  to 
provide  the  human  operator  with  im¬ 
proved  visual  capabilities.  Following 
:  Operation  Desert  Storm’s  demonstra¬ 
tion  of  the  effectiveness  of  air  opera¬ 
tions  in  low-light/night  conditions, 
CFHV  has  put  special  emphasis  on 
supporting  the  integration  of  night  vi¬ 
sion  technology  in  the  HSD  advanced 
development  Helmet-Mounted  Systems 
Technology  Program.  The  new  gen¬ 
eration  of  night  vision  systems  will  fit 
under  a  pilot’s  visor,  have  an  improved 
,  center  of  gravity,  and  weigh  signifi- 
!  candy  less  than  existing  equipment. 

The  scientists  and  engineers  of  the 
Visual  Display  Systems  Branch  are  pro¬ 
viding  valuable  support  to  industry 
!  through  their  leadership  in  developing 
i  aircraft  windscreen  testing  methods 
I  and  standards.  Procedures  have  al- 
|  ready  been  produced  for  testing 
such  parameters  as  haze,  angular  de¬ 
viation,  reflections,  multiple  images, 
and  others.  A  second  important 
aspect  of  this  program  is  relating  the 
|  various  windscreen  parameters  to 
!  actual  human  performance;  i.e., 

I  how  much  is  the  mission  affected 
i  by,  for  example,  various  levels  of 
|  haze  or  reflections  in  the  windscreen? 

I  It  is  important  to  know  if  some  of 
!  the  windscreen  aberrations  degrade 
|  pilot  effectiveness  more  than  others? 

The  Future 

Some  of  the  target  areas  to  be  ad- 
;  dressed  by  HE  scientists  as  they  fulfill 
j  their  portion  of  the  new  Armstrong 
|  Laboratory  mission  are  1)  the  human 
j  factors  of  manufacturing  technology, 

|  2)  ergonomics  of  crew  stations  in  hy- 
l  personic  vehicles,  3)  capitalizing  on 
;  HE’s  experience  in  physical  anthropol- 
|  ogy  by  expanding  from  head-scanning 


|  to  full-body  technology,  4)  computer- 
|  supported  collaborative  work,  and  5) 
using  virtual  reality  in  crew  system 
interfaces  and  design  facilities. 

An  example  of  the  HE  involvement 
in  these  new  scientific  thrusts  is  the 
work  presently  being  accomplished 
under  5)  above.  The  CASHE  (Com¬ 
puter-Aided  Systems  Human  Engineer¬ 
ing)  program  is  developing  an  interac- 
!  tive,  data-driven,  prototyping  system 
which  allows  access  to,  and  simu¬ 
lation  of,  multiple  sources  of  human 
engineering  data,  utilizing  multi-media 
presentation  and  hypertext  tech¬ 
niques  to  link  the  various  sources. 
Ultimately,  CASHE  will  provide  the 
capability  for  a  design  team  to  assess 
the  human  performance  implications 
of  equipment  design  decisions.  The 
combined  use  of  integrated  CRTs, 
small  group  wall  displays,  auditory 
systems,  and  virtual  display  technolo¬ 
gies  will  allow  designers  to  fully 
visualize  and  experience  the  opera¬ 
tional  impact  of  the  crew  system  de¬ 
sign,  even  in  its  early  conceptual  de¬ 
sign  phase.  This  computer-aided 
systems  human  engineering  ap¬ 
proach  will  help  designers  and  acqui¬ 
sition  managers  to  efficiently  access 
and  trade  off  human  performance 
data  with  other  engineering  data 
relevant  to  the  design  of  effective 
human  systems. 

In  a  world  without  a  Cold  War, 
where  defense  dollars  are  being  di¬ 
verted  to  other  purposes,  the  Depart¬ 
ment  of  Defense  must  make  each 
dollar  count.  If  it  cannot  buy  more, 
then  it  must  buy  “smarter.”  Restruc¬ 
turing  DoD  organizations  is  one 
solution  for  increasing  efficiency,  ac- 
!  complished  by  streamlining  the  man- 
!  agement  chain  and  eliminating 
duplication  of  effort.  With  the  recent 
reorganization,  the  Human  Engineer¬ 
ing  Division  of  the  Armstrong  Labora¬ 
tory  Crew  System  Directorate  is 
confident  it  is  in  a  better  position  to 
ensure  that  our  men  and  woman  in 
uniform  will  continue  to  be  part  of 
the  most  operationally  efficient  and 
technologically  superior  military  force 
in  the  world.  • 
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TECHNICAL  SUMMARY  AND  ANALYSIS  SERVICES 


What  is  a  Technical  Inquiry? 

Simply  stated,  a  technical  in¬ 
quiry  is  a  request  for  ergonom¬ 
ics  information.  In  general,  er¬ 
gonomics  information  is  tech¬ 
nical  knowledge  about  human 
abilities  andperfoimance,  which 
can  be  used  to  enhance  equip¬ 
ment  design  and  development. 

CSERIAC  ’s  answer  to  inquir¬ 
ies  can  take  many  forms,  in¬ 
cluding  customized  biblio¬ 
graphic  searches,  review  and 
analysis  of  research,  recommen¬ 
dations  based  on  analyses,  and 
expert  consultation  referrals. 
We  have  grouped  these  into 
three  basic  categories,  based  on 
the  kind  and  amount  of  ergo¬ 
nomics  expertise  applied  to  the 
problem.  The  three  categories 
are  Search  and  Summary,  Re¬ 
view  and  Analysis,  and  Techni¬ 
cal  Area  Tasks.  A  fixed  fee 
has  been  established  for  the 
first  two;  Technical  Area  Tasks 
must  be  negotiated  on  an  indi¬ 
vidual  basis. 

Search  and  Summary 

Search  and  Summary  consists 
of  a  literature  search  and  a  print¬ 
out  of  relevant  abstracts,  which 
are  then  bound  in  a  booklet.  A 
professional  human  factors  ana- 


y  I  Is  • 

£ 


■■  «:  v| 


'grr 

:  i  v,  I 


' 

Hill 

- '  F' 

■ 


lyst  reviews  the  abstracts  and 
identifies  the  most  pertinent. 
The  human  factors  analyst  also 
consults  references  within 
CSERIAC’s  immediately  ac¬ 
cessible  resources  and  provides 
comments  and/or  excerpts  from 
these  references.  The  main 
purpose  of  this  level  of  response 
is  to  provide  a  very  rapid 
response  to  requests  for  techni¬ 
cal  information. 

Review  and  Analysis 

This  level  of  response  includes 
all  of  the  above  plus  direct  con¬ 
tact  with  subject-matterexperts, 
a  3-to-7  page  white  paper  syn¬ 
thesizing  the  results  of  the  tech¬ 
nical  review,  complete  copies 
and/or  excerpts  from  relevant 
documents,  and  names,  ad¬ 
dresses,  and  telephone  num¬ 
bers  of  subject-matter  experts. 
It  also  includes  the  requisite 
materials  for  access  to  data- 
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bases  and  personal  contact  with 
the  subject-matterexperts.  The 
main  purpose  of  this  level  of 
response  is  the  in-depth  synthe¬ 
sis  of  the  literature  with  the 
formation  of  an  authoritative 
‘ ‘conclusion”  or  answer  regard¬ 
ing  the  question  posed. 

Technical  Area  Tasks 

In  this  category  are  those  in¬ 
quiries  requiring  major 
CSERIAC  time  and  material 
expenditures,  such  as  prepara¬ 
tion  of  state-of-the-art  reports 
(SOARs),  critical  reviews, 
technical  assessments,  and 
handbooks,  organizing  work¬ 
shops  and  symposia,  or  exer¬ 
cising  computer  models  in 
our  technology  transfer  inven¬ 
tory.  The  main  purpose  of  this 
level  of  response  is  an  exten¬ 
sive  customized  effort  directed 
at  solving  the  customer’s  par¬ 
ticular  needs. 


Previous 

TOPICS 


Pilot  Decision-Making 
Under  Stress 
Speech  Synthesis  and 
Recognition 
Human  Tolerances  to 
Impact 

Operator  Workload 
Assessment:  Subjective 
Techniques  Design 
Guidelines  for  Human- 
Computer  Interaction 
Cumulative  Trauma 
Disorders  in  the 
Workplace 
Shift  Work  and  Sleep 
Deprivation 
Human  Error 
International 
Anthropometric  Data 
Sources 

Color  Coding  and 
Visual  Displays 


Previous 

CUSTOMERS 


■  NASA 

■  General  Motors 
Corporation 

■  AT&T  Bell  Laboratories 

■  US  Army  Tank-Automo¬ 
tive  Command 

■  University  of  Illinois 

■  Texas  Instruments  Inc. 

■  US  Consumer  Product 
Safety  Commission 

■  NCR  Corporation 

■  Naval  Air  Warfare  Center 

■  Ford  Motor  Company 

■  FAA  Technical  Center 

■  US  Nuclear  Regulatory 
Commission 

For  More  Information  Contact: 
Mike  Gravelle 
Senior  Technical  Analyst 
CSERIAC  Program  Office 
(513)255-4842 
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Liveware  Survey  of 

Human  Systems  Integration  (HSI)  Tools 

Frank  C.  Gentner 
Mona  J.  Crissey 


Oow  do  you  know  which 
databases  and  tools 
can  to  be  used  for  the  re¬ 
quired  HSI  analyses  during  systems 
acquisition?  Today’s  answer  is  by 
conducting  searches,  referencing  many 
documents,  and  you  will  probably  still 
miss  some.  We  hope  to  have  an 
answer  to  the  problem  faced  recur¬ 
rently  by  HSI  focal  points  and  their 
Defense  contractors.  Tomorrow’s 
solution  is  to  conduct  a  survey  of  all 
HSI  tools,  methods,  and  databases; 
place  the  results  in  an  easily  acces¬ 
sible  database;  and  make  the  informa¬ 
tion  available  in  catalogue  and  com¬ 
puter  disk  format.  This  is  exactly 
wrhat  is  planned  under  the  Liveware 
Survey  and  Database  Program. 
Before  we  explain  the  mechanics  of 
the  survey,  let  us  see  what  got  this 
project  started. 

Project  Summary 

Pressures  to  accomplish  more 
with  smaller  defense  forces,  and  wid¬ 
ening  interest  and  direction  in  Human 
Systems  Integration  have  accelerated 
the  need  for  comprehensive  informa¬ 
tion  about  available  HSI  tools  and 
databases.  HSI  studies,  analyses,  and 
plans  are  now  required  throughout 
the  Defense  acquisition  process,  as 
directed  by  Department  of  Defense 
(DoD)  Instruction  5000.2,  Defense 
Acquisition  Management  Policies 
and  Procedures.  In  addition,  North 
Atlantic  Treaty  Organization  (NATO) 
countries  have  become  interested 
in  HSI  as  a  means  to  ensure  effective 
development/modification  of  de¬ 
fense  systems.  Moving  to  meet  this 
NATO-wide  need,  the  Office  of  the 
Assistant  Secretary  of  Defense 


i  (OASD)  for  Force  Management  and 
:  Personnel  (FM&P)  HSI  Office  tasked 
the  Defense  Training  and  Performance 
Data  Center  (TPDC)  to  develop  a  com¬ 
prehensive  database  of  “Liveware”  in¬ 
formation.  “Liveware”  is  the  name 
coined  to  describe  collectively  all  ac¬ 
quisition  disciplines  which  directly  af¬ 
fect  humans  in  defense  systems. 
Liveware  domains  include  Manpower, 
Personnel,  Training,  Safety,  Health 
Hazards  Prevention,  and  Human  Fac¬ 
tors  Engineering,  the  same  disciplines 
involved  in  HSI. 

To  build  the  Liveware  database, 
TPDC  developed  automated  and 
manual  survey  instruments  to  collect 
essential  information  from  HSI  tool 
and  database  developers,  maintainers, 
and  users.  The  survey  questions 
were  approved  by  the  NATO  Research 
Study  Group  (RSG).21.  CSERIAC 
was  enlisted  to  assist  with  the  survey 
and  verification  of  database  content. 

|  The  resulting  database  will  be  avail- 
j  able  on-1'  3  and  on  disk  to  the 
1  government  and  industry  acquisi- 
'  tion  communities.  This  database 

t 

will  support  use  of  HSI  tools  and 
databases  throughout  the  acquisi¬ 
tion  process.  In  addition,  the  database 
i  will  include  the  results  furnished 
!  by  other  NATO  nations  collected 
1  from  their  internal  surveys.  The  goal 
is  to  help  Defense  acquisition 
personnel  and  their  contractors  use 
HSI  tools,  techniques,  and  data 
to  develop  the  most  cost-effective 
defense  systems  possible.  By  op¬ 
timizing  the  use  of  and  environ- 
;  ment  for  people  using  HSI  tools  and 
databases,  the  goal  of  greater 
consideration  of  people-related 
issues  within  developing  defense  sys¬ 
tems  can  be  reached. 


Background 

Gaining  Momentum 
DoD  and  Government  Accounting 
Office  studies  found  that  the  weapon 
system  acquisition  process  could  be 
improved  by  focusing  more  attention 
on  Manpower,  Personnel,  Training, 

|  Safety/Health  Hazard  Prevention 
(MPTS)  and  Human  Factors  Engineer¬ 
ing  (HFE)  throughout  acquisition.  In 
1986,  Deputy  Secretary  of  Defense, 
William  Taft,  tasked  the  OASD(FM&P) 
to  oversee  and  remove  systemic  causes 
of  human-centered  problems  in  de¬ 
fense  systems,  and  establish  a  method 
!  of  ensuring  continuing  emphasis  in 
this  critical  area  of  the  acquisition  pro- 
:  cess.  Several  DoD-  and  Service-level 
s  working  groups,  convened  to  imple¬ 
ment  this  direction,  realized  that  HSI 
j  requirements  needed  to  be  established 
as  an  integral  part  early  in  the  acquisi¬ 
tion  process  to  influence  design. 

DoD  Policy 

The  resulting  policy  was  published 
in  DoD  Directive  5000.1,  “Defense  Ac- 
|  quisition,”  and  DoD  Instruction  5000.2, 
|  “Defense  Acquisition  Management  Poli- 
i  cies  and  Procedures”  (February  1991). 
i  These  directives  included  major  sec¬ 
tions  on  HSI;  Systems  Engineering/ 
HFE;  Integrated  Logistics  Support/Man¬ 
power,  Personnel,  and  Training  (MPT) 
elements;  and  System  Safety.  These 
sections  emphasize  that  the  human- 
machine  interface  must  be  routinely 
|  considered  throughout  the  acquisition 
|  process.  For  example,  the  HSI  section 
states,  “Human  considerations  shall  be 
effectively  integrated  into  the  design 
effort  for  defense  systems  to  improve 
total  system  performance  and  reduce 
costs  of  ownership  by  focusing  atten- 
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Table  1 

HSI  Survey  Efforts 


EFFORT 


Title 

Author(s) 

Corporation 

Sponsor 

Date 


(Related  studies  follow  each  other) 


Advanced  Human  Factors  Engineering 
Tool  Technologies. 

Fleger,  Permenter,  and  Malone.  Carlow 
Associates,  Inc.  U.S.  ARMY  Human 
Engineering  Lab  (USAHEL).  1988 


Integrated  Decision/Engineering  Aid 
(IDEA). 

Carlow  International,  Inc.  USAHEL.  1992 


Analysis  Of  MPT(S)  During  Acquisition 
of  AF  Systems. 

Rossmeissl,  Akman.  Kerchner.  Faucheux, 
Wright.  Shields,  and  Waldrop.  Hay 
Systems,  Inc.  AF  Human  Systems 
Division  (AFSC).  1990 


AF  Human  Systems  Integration  Tools 
and  Databases. 

Gentner.  Aeronautical  Systems  Division 
(ASD)  Manpower,  Personnel,  & 
Training  Directorate  (ALH).  1991 


Directory  of  Design  Support  Methods. 
Bogner,  Kibbe.  Laine.  Hewitt.  Army 
Research  Institute.  MANPRINT  Office, 
DoD  HFE  Technical  Group  (TG).  1990 


Logistics  Support  Analysis  Techniques 
Guide  (AMC  Pamphlet  700-4) 

U.S.  Army  Material  Command  (AMC) 
Material  Readiness  Support  Activity.  1991 


Survey  of  Manpower  Personnel  Software 
Development  Tools. 

Bravo  and  Bakalarski.  Dynamics 
Research  Corporation.  Computer-Aided 
Acquisition  &  Logistics  Support  (CALS) 
Human  Systems  Components  (HSC) 
Committee.  1991 


Survey  of  CALS  Training  Development 
Software  Tools. 

Wall  and  Tucker.  Raytheon,  Inc.  CALS 
HSC  Committee.  1990 


Liveware  Integration  in... Acquisition: 
Review  of  Canadian  Organization,  Toots, 
&  Technologies. 

Beevis.  Canadian  Defense  &  Civil 
Institute  of  Environmental  Medicine, 
Human  Factors  Division.  1991 


DoD  Liveware  Survey 
Crissey  and  Gentner.  CSER1AC  and 
TPDC.  OASD(FM&P)/R&R(TFR)  HSI 
Office.  1992  (In  progress) 
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tion  on  the  capabilities  and  limitations 
of  the  soldier,  sailor,  airman,  or  ma¬ 
rine.”  Human  element  objectives  shall 
be  “initially  established  at  Milestone 
I...and  subsequently  refined  and  up¬ 
dated  at  successive  milestone  decision 
points.”  The  Services  are  now  imple¬ 
menting  this  policy  through  supple¬ 
ments  to  this  landmark  directive. 


NATO  RSG.21 

NATO  was  concerned  about  how 
the  human-machine  interface  was  be¬ 
ing  addressed  during  weapon  system 
acquisition.  This  concern  led  to  the 
establishment  of  RSG.21,  Liveware  In¬ 
tegration  in  Weapon  System  Acquisi¬ 
tion,  by  NATO  Defense  Research  Group 
Panel  8,  Defense  Applications  of  Hu¬ 
man  and  Bio-medical  Sciences.  Par¬ 
ticipant  nations  are  Canada,  France, 
Germany,  the  Netherlands,  the  United 
Kingdom,  and  the  United  States.  NATO 
tasked  RSG.21  to  identify,  define,  de¬ 
scribe,  and  document  the  tools,  tech¬ 
niques,  and  databases  that  enhance  the 
early  consideration  and  integration  of 
manpower,  personnel,  training,  sys¬ 
tem  safety,  health  hazard  prevention, 
and  HFE  requirements/issues  into  the 
acquisition  process.  In  addition,  they 
were  to  evaluate  findings  and  identify 
gaps  and  voids  in  technology. 


HSI 


In  the  United  States,  the  Liveware 
program  is  called  HSI  at  the  DoD  level. 
Implementation  programs  at  the  Ser¬ 
vice  level  include  Army  Manpower- 
Personnel  Integration  (MANPRINT), 
Navy  Hardware-Manpower  (HARDMAN), 
and  Air  Force  Integrated  Manpower, 
Personnel,  And  Comprehensive  Train¬ 
ing  &  Safety  (IMPACTS).  These  pro¬ 
grams  attempt  to  ensure  that  Liveware 
issues  are  treated  as  thoroughly  as 
hardware  and  software  issues. 


CALS  Efforts 

Industry  and  Government  have  joined 
forces  in  an  initiative  named  Com¬ 
puter-Aided  Acquisition  and  Logistics 
Support  (CALS).  It  is  an  effort  to 
improve  weapon  systems  quality,  re- 
Continued  on  page  22 
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Figure  1.  The  Liveware  Survey  is  available  on  both  disk  and  paper. 


duce  development  time,  and  decrease 
costs  by  using  digital  technology  in 
the  generation,  access,  management, 
maintenance,  distribution,  and  use  of 
technical  information.  The  CALS  strat¬ 
egy  is  to  develop  methods  of 
transitioning  from  paper-intensive,  non- 
integrated  weapon  system  engineer¬ 
ing,  production,  and  logistic  support 
processes  to  an  automated  and  inte¬ 
grated  operational  mode.  The  CALS 
concept  is  to  collect  standardized  data 
once,  then  use  it  many  times  for  mul¬ 
tiple  purposes.  A  CALS-HSI  sub-com¬ 
mittee  was  formed  as  an  integral  part 
of  this  effort.  One  of  their  functions  is 
to  identify  available  software  tools  and 
databases  for  use  during  acquisition. 

Previous  HSI  Tool  Survey  Efforts 

Although  several  previous  efforts 
list  HSI  tools  and  databases,  none 
have  been  comprehensive  of  all  do¬ 
mains  or  all  Services.  Table  1  summa¬ 
rizes  these  efforts. 

NATO  Study  Purpose  and  Objectives 

The  purpose  and  objectives  of  RSG.21 
are  “(1)  The  identification,  definition, 
and  description  of  techniques,  tools, 
databases,  and  data  collection  systems 


that  enhance  the  -early  consideration 
and  integration  of  Liveware  factors  to 
improve  the  operational  performance 
and  cost-effectiveness  of  new  or  modi¬ 
fied  weapon  systems;  (2)  The  docu¬ 
mentation  of  all  existing  Liveware-inte¬ 
gration  technologies  into  formats  suit¬ 
able  for  practical  use  in  accommodat¬ 
ing  profiles,  report  requirements, 
and  trade-off  analyses  at  the  appropri¬ 
ate  milestone-review  points  in  the  ac¬ 
quisition  process;  and  (3)  The  identifi¬ 
cation  and  documentation  of  Liveware- 
integration  technology  gaps,  to  include 
a  broad  outline  with  recommended 
prioritization  of  research  and 
development  efforts  designed  to  close 
those  gaps.” 

Study  Scope,  Milestones,  and 
Players 

Overall  Scope 

The  scope  of  the  Liveware  Survey  is 
the  collection  and  system  automation 
of  information  about  existing  and 
emerging  tools,  techniques,  and  data¬ 
bases  for  all  the  domains  which  com¬ 
prise  Liveware.  The  resulting  database 
will  provide  the  DoD,  Services,  De¬ 
fense  Contractors,  and  NATO  coun¬ 
tries  with  access  to  the  most  complete 


catalog  of  HSI  technologies.  Each 
nation  participating  in  RSG.21  is  re¬ 
sponsible  for  the  solicitation,  collec¬ 
tion,  and  interpretation  of  national  tech¬ 
nologies.  The  data  collected  will  be 
consolidated  into  an  unclassified  mas¬ 
ter  database  (see  database  benefits 
summarized  in  Table  2.). 

U.S.  Data  Collection  Methods 

Data  collection  in  the  United  States 
will  take  several  forms.  A  literature 
search  will  be  completed.  Hardcopy 
survey  information  will  be  scanned  for 
appropriate  data.  POCs  will  be  identi¬ 
fied.  Contact  will  be  made  and  infor¬ 
mation  gathered  and  verified  using  a 
combination  of  collection  tools.  These 
include  mail-out  paper  survey  forms  or 
an  automated  survey  diskette  (see  Fig. 
1),  and  telephone  or  face-to-face  inter¬ 
views. 

Data  Entry  and  Verification.  The 
collected  data  will  be  entered  by  auto¬ 
mated  or  manual  means.  Subject  mat¬ 
ter  experts  and  the  POC  will  verify 
using  catalog  format  printouts  during 
discussions  with  CSERIAC  personnel. 
Data  about  each  program  will  be  col¬ 
lected  from  the  owner/developer  as 
well  as  users.  The  extent  to  which 
technologies  are  used  and  the  type  of 


Table  2 

Liveware  Database  Benefits 


Liveware 
Database  Quality 

Benefits 

Comprehensive 

One  Data  Source,  Rather 
Than  Many;  One  Effort 

Used  For  Many  Purposes 

On-Line/On  Diskette 
Access 

Quick  &  Efficient  Access, 
Time  Saver  Most  Current 
Information 

Index  & 

Cross-References 

Easy  To  Identify 

Appropriate  Technology 

Standardized  Format 

Easy  to  Compare  & 

Contrast  Technologies 

POC  &  User 

Identification 

Obtain  Balanced  Point  of 
View,  Detailed  Information, 
Application  Information 

NATO-Wide  Information 

Promotes  Sharing 

Technology,  Innovative 
Approaches 
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uses  are  valuable  in  identifying  the  gaps 
and  voids  when  establishing  require¬ 
ments  for  new  technologies.  Therefore, 
data  collection  will  involve  the  entire 
acquisition  community. 

Paper  Survey.  The  paper  survey  or 
interview  requires  about  20  minutes  of 
manual  entry  time  by  a  person  knowl¬ 
edgeable  about  the  Liveware  program. 
The  completed  survey  can  either  be 
mailed  or  telefaxed  to  TPDC,  where  it 
will  be  entered  into  the  master  database. 

Automated  Diskette.  The  most  effi¬ 
cient  collection  tool  is  the  automated 
diskette.  The  diskette  comes  in  a 
package  containing  a  User’s  Guide  and 
instructions  for  data  entry.  The  dis¬ 
kette  can  be  used  on  any  MS  DOS- 
compatible  computer.  It  contains  all 
data  entry  screens;  on-screen  help;  and 
easy  entry,  update,  and  retrieval  com¬ 
mands.  In  addition,  the  diskette  con¬ 
tains  some  sample  data  to  demonstrate 
report  capabilities.  It  provides  a  small 
stand-alone  system  which  can  provide 
an  inventory  of  all  Liveware  used  by  an 
organization.  A  copy  of  the  informa¬ 
tion  entered  on  the  diskette  is  to  be 
mailed  to  TPDC  for  input  into  the 
master  Liveware  database. 

Liveware  Survey  and  Database 
Players  and  Milestones 

Players 

The  following  organizations  are 
participating  in  the  development  of 

Table  3 

Liveware  Survey  &  Database 
Milestones 


■  Data  Collection  and  Update : 

March  to  December  1992 

■  On-line  System  Development: 

March  1992  to  February  1993 

■  On-Line  System  Available: 

March  1993 

■  First  Hardcopy  Catalog  Available: 

March  1993 


the  Liveware  database  and  data  collec¬ 
tion  effort. 

OASD(FM&P)/R&R(TFR)HSI,  as  chair 
of  RSG.21,  developed  the  initial  re¬ 
quirements  for  the  system  and  main¬ 
tains  approval  authority  for  the  data¬ 
base  concept  and  collection  tools. 

TPDC  designed  and  developed 
the  prototype  database  and  collection 
tools;  and  will  develop  and  maintain 
the  on-line  system,  input  and  verify 
the  collected  data,  and  act  as  project 
manager. 

CSERIAC  will  support  the  data  col¬ 
lection  and  verification,  act  as  subject 
matter  expert,  evaluate  the  collection 
tools,  and  provide  publicity  and  mar¬ 
keting  opportunities. 

Milestones 

Survey  and  database  milestones  are 
presented  in  Table  3. 

Survey  Questions 

The  survey  questions  are  divided 
into  three  sections:  general  program 
information,  descriptive  information, 
and  owner/user  information.  A  sample 
page  of  section  3  is  presented  in  Fig.  2. 
Questions  followed  with  blank  lines 
require  entry  of  words  or  text  as  appro¬ 
priate.  Many  questions  can  be  an¬ 
swered  by  choosing  a  code  or  multiple 
codes,  and  some  narrative  description 
is  requested. 

Participation  Essential 

For  this  survey  to  live  up  to  its 
potential,  all  tool  developers  and 
owners  must  request  a  survey  instru¬ 
ment,  complete,  and  return  it  to 
TPDC.  By  making  this  information 
available  NATO-wide,  we  hope  to  im¬ 
prove  the  consideration  of  human- 
centered  issues  in  acquisitions  and 
modifications.  We  hope  the  desire  to 
meet  this  commendable  goal  will  be 
enhanced  by  furnishing  free  publicity 
for  tool  developers.  The  resulting 
dialogue  between  users,  developers, 
and  maintainers  should  help  encour¬ 
age  tool  use,  lead  to  improved  tool 
design,  and  result  in  acquisitions  of 
more  cost-effective  defense  systems. 
The  OASD(FM&P)/  R&R(TFR)  Human 


SECTION  3 

LIVEWARE  OWNER/USER  INFORMATION 

3.1  OWNER/USER  INFORMATION: 

Point  of  Contact’s  organization  or  commercial  Firm  program  association:  (Circle  one) 
Q  -  Owner  U  =  User  B  =  Both  Owner  and  User 

Owner/User  organization  or  commercial  firm  name: 

Organization  or  commercial  firm  address: 

Street: _ 

Citv: 

State  Code: _  ZIP: _  Country  Code: _ 

Commercial  Telephone  Number: _ 

Commercial  Telefax  Number: _ 

DSN  Telephone  Number: _ 

DSN  Telefax  Number: _ 

Point  of  Contact  Name: _ 

Rank  or  Title: _ 

User  work  discipline:  (Circle  one) 

M  =  Management  E  =  Engineer/Designer 

S  =  Scientist/Researcher  T  =  Training  Developer 
.Q  =  Cost  Analyst  O  =  Other 

Required  days  of  training: _ 

Frequency  of  program  use:  (Circle  one) 

D  =  Daily  W  =  Weekly  M  =  Monthly  Q  =  Quarterly 
S  =  Semiannually  Y  -  Yearly  R  =  As  Required 

Program  user  community  sector:  (Circle  one) 

C  =  Commercial  M  =  Military  G  =  Government 

LIVEWARE  domains  applied  during  program  use:  (Circle  all  that  apply) 

M  =  Manpower  P  =  Personnel 

T  =  Training  §  =  Safety 

H  =  Health  Hazard  E  =  Human  Factors  Engineering 

}  =  Integration 


Figure  2.  A  sample  page  from  the  survey 

Systems  Integration  offices  encourages 
your  participation. 

Where  to  Obtain  the  Survey 
The  survey  is  available  in  either 
hardcopy  or  automated  format.  To 
obtain  it,  call,  write,  or  telefax  your 
request  to  the  following  address/ 
number.  Specify  which  collection 
tool  format  you  prefer  for  your  data 
entry.  Submit  completed  forms  to  the 
same  address.  • 

Defense  Training  and 
Performance  Data  Center 
ATTN:  Liveware  Project  Manager, 
M.  Crissey 
3280  Progress  Drive 
Orlando,  FL  32826-3229 

Telephone: 

(407)281-3643 
FAX:(407)  282-8922 
E-Mail: 

TPDC047@TPDC.NAVY.MIL 

Frank  Gentner  is  the  Senior  HSI  Technical 
Analyst  for  CSERIAC. 

Mona  Crissey,  Ph.D.,  is  the  Liveware  Pro¬ 
gram  Analyst  at  the  Defense  Training  and 
Performance  Data  Center ;  Orlando,  FL. 
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CSEBIAC 
PRODUCTS  AMD 
SERVICES 

CSERIAC's  objective  is  to  acquire, 
analyze,  and  disseminate  timely  infor¬ 
mation  on  crew  system  ergonomics 
(CSE).  The  domain  of  CSE  includes 
scientific  and  technical  knowledge  and 
data  concerning  human  characteris¬ 
tics,  abilities,  limitations,  physiological 
needs,  performance,  body  dimensions, 
biomechanical  dynamics,  strength,  and 
tolerances.  It  also  encompasses  engi¬ 
neering  and  design  data  concerning 
equipment  intended  to  be  used,  oper¬ 
ated,  or  controlled  by  crew  members. 

CSERIAC's  principal  products  and 
services  include: 

•  technical  advice  and  assistance; 


•  customized  responses  to  biblio- 
|  graphic  inquiries; 

•  written  reviews  and  analyses  in 
■  the  form  of  state-of-the-art  reports  and 
:  technology  assessments; 

•  reference  resources  such  as  hand- 
!  books  and  data  books. 

Within  its  established  scope,  CSERIAC 
;  also: 

•  organizes  and  conducts  work¬ 
shops,  conferences,  symposia,  and 

|  short  courses; 

I  •  manages  the  transfer  of  techno- 
|  logical  products  between  developers 
and  users; 

•  performs  special  studies  or  tasks 
for  government  agencies. 

Services  are  provided  on  a  cost- 
:  recovery  basis.  An  initial  inquiry  to 
:  determine  available  data  can  be  ac- 
|  commodated  at  no  charge.  Special 
;  tasks  require  approval  by  the  Program 
|  Manager. 


To  obtain  further  information  or  re¬ 
quest  services,  contact: 

CSERIAC  Program  Office 
AL/CFH/CSERIAC 

Wright-Patterson  AFB,  OH  45433-6573 

Telephone . (513)  255-4842 

DSN . 785-4842 

Facsimile . (513)  255-4823 

Government 

Technical  Manager . (513)  255-8821 

Associate  Director:  Dr.  Lawrence  D. 

|  Howell ;  Govern ment  Tech n ical Manager: 
Dr.  Reuben  L.  Hann;  DoD  Technical 
Director:  Dr.  Kenneth  R.  Boff. 
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